Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Not seen this before atrax1.pa-x.dec.com |
5 | engine | 8:22 pm Oct 12, 2000 | ||||
| Sidewinder is slithering (Go/Infoseek) |
12 | littleman | 7:22 pm Oct 12, 2000 | ||||
| Boobook |
6 | littleman | 8:13 pm Oct 9, 2000 | ||||
| Who are these? |
7 | Hope | 1:10 pm Oct 9, 2000 | ||||
| What spider is this? |
4 | steven | 10:20 pm Oct 5, 2000 | ||||
| Slurp fake? |
4 | rpking | 7:53 am Oct 5, 2000 | ||||
| Scooter hitting submits. |
4 | pete | 11:31 am Oct 4, 2000 | ||||
| Something Different? Not sure what this. |
3 | drbill | 3:16 am Sep 22, 2000 | ||||
| 216.32.64.10 ? |
5 | mark roach | 8:23 pm Sep 21, 2000 | ||||
| Brett's IP lists maybe some corrections needed.. |
9 | PeteU | 4:36 am Sep 19, 2000 | ||||
| Strange Request from inktomi2-not.server.ntl.com |
2 | shri | 7:03 am Sep 18, 2000 | ||||
| NEW Spider?? Anybody seen this guy before |
3 | drbill | 1:16 am Sep 13, 2000 | ||||
| infoseek spiders? |
2 | roscoepico | 9:04 pm Sep 11, 2000 | ||||
| AskJeeves Crawler? Was I sleeping, and missed some topic on this? :) |
3 | redzone | 2:11 pm Sep 8, 2000 | ||||
| 1x1 pixel links on index page |
8 | knoxy | 11:28 pm Sep 7, 2000 | ||||
| Help needed |
7 | adamcmoran | 1:46 am Sep 7, 2000 | ||||
| Directhit is crawling hard. Mozilla/4.06 [en] (Direct Hit Grabber) |
11 | littleman | 7:25 pm Sep 6, 2000 | ||||
| Indeed it is |
2 | adamcmoran | 2:51 pm Sep 6, 2000 | ||||
| Houston5 |
3 | bluesriff | 11:43 pm Sep 3, 2000 | ||||
| who owns this IP? 24.165.231.85 |
4 | symmetry | 6:10 pm Sep 1, 2000 | ||||
| AOL HTTP Requests w/ No User Agent? Anyone else seeing this in their logs? |
2 | redzone | 3:18 pm Aug 31, 2000 | ||||
| crawler0-complaints-to-admin.webresearch.pa-x.dec.c Have I been sprung? |
5 | han chung | 8:35 pm Aug 27, 2000 | ||||
| av? |
7 | roscoepico | 7:31 am Aug 26, 2000 | ||||
| "Kite-Hourly" Intomi spider ?? |
3 | grnidone | 3:07 pm Aug 23, 2000 | ||||
| BEWARE... might be a sniffer.... |
5 | Kamikaze | 11:07 pm Aug 21, 2000 |
