Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| ZyBorg 1.0 (zyborg@wisenutbot.com) 216.34.42.211 |
18 | skirril | 3:56 pm July 24, 2002 | ||||
| cadabra.com webcrawler Have you seen this? |
5 | coconutz | 8:29 pm July 22, 2002 | ||||
| What is Gigabot ? |
4 | bcc1234 | 9:34 pm July 21, 2002 | ||||
| Mercator-2.0 Does anyone know what Mercator-2.0 is? |
5 | davros | 3:36 am July 21, 2002 | ||||
| C-macos8 |
4 | wilderness | 12:08 am July 21, 2002 | ||||
| flunky -- anyone seen this spider? 66.28.20.194 flunky -- crawling my sites. |
16 | gethan | 10:52 pm July 20, 2002 | ||||
| add2.dir.scd.yahoo.com |
4 | smokin | 10:21 pm July 19, 2002 | ||||
| Openfind |
4 | volatilegx | 3:16 pm July 19, 2002 | ||||
| crawler3.wib.pa-x.dec.com ? Anyone recognize this Spider? |
5 | 24bit | 4:33 am July 19, 2002 | ||||
| openfind wont go away.... |
6 | Dpeper | 11:05 pm July 18, 2002 | ||||
| Java1.3.1 user agent grabbing pages via wireless network? |
3 | idiotgirl | 1:36 pm July 18, 2002 | ||||
| Lachesis venomous snake or weird bot? |
3 | idiotgirl | 6:19 pm July 17, 2002 | ||||
| 212.30.114.9 Does anyone know who this is ? |
7 | Visit_Thailand | 1:10 pm July 17, 2002 | ||||
| spider.batsch.com Does anyone have info on this spider? |
5 | smokin | 6:32 pm July 16, 2002 | ||||
| 64.29.137.164 this ring a bell for anyone? |
3 | Weblamer | 5:41 pm July 16, 2002 | ||||
| 64.140.48.30 Who should this be |
6 | BrunoDillen | 5:28 pm July 16, 2002 | ||||
| Fetch API Request - Help! I know more about it but I'm even more puzzled now! |
9 | Dreamquick | 3:43 pm July 15, 2002 | ||||
| What is Indy library and can I get them to go away |
12 | korkus2000 | 2:37 pm July 14, 2002 | ||||
| New Wisenut Spider |
7 | fiestagirl | 6:10 pm July 13, 2002 | ||||
| larbin (samualt9@bigfoot.com) Anyone seen this before |
5 | fathom | 6:17 am July 13, 2002 | ||||
| 66.196.72.58 |
2 | Visit_Thailand | 1:57 am July 13, 2002 | ||||
| Inktomi Hosts Any info on Inktomi identification? |
2 | cnegs44 | 9:06 am July 12, 2002 | ||||
| ipd/1.0 Has anyone else seen this one? |
10 | Pushycat | 2:01 pm July 11, 2002 | ||||
| bad spider, no UA, no read of robots.txt where's my newspaper.... |
6 | dcheney | 5:55 am July 11, 2002 | ||||
| bigip1a-snat.sv.av.com who is from altavista ? |
2 | berno | 7:32 pm July 10, 2002 |