Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| QuePasaCreep v0.9.13 from ipa 69.28.130.229 new semi-bogus spider? |
18 | rodent | 9:01 am July 31, 2003 | ||||
| Anyone recognise this? |
2 | davelms | 7:40 pm July 30, 2003 | ||||
| New Exalead UA string? |
3 | jrobbio | 12:44 am July 30, 2003 | ||||
| Spoofing LookSmart? Fell into Spider Trap |
2 | frontpage | 11:50 pm July 29, 2003 | ||||
| Anybody recognise this ip? Just checking the log's when I found this |
13 | Glovebox | 10:55 pm July 29, 2003 | ||||
| allowing 403 page to denied IPs |
5 | nancyb | 10:40 pm July 29, 2003 | ||||
| AOLserver |
2 | wilderness | 4:40 pm July 29, 2003 | ||||
| Dolly/1.0 Anyone else see this? |
8 | Finder | 9:41 pm July 28, 2003 | ||||
| 216.88.0.0-216.91.255.255 Savvis Communications - why spidering? |
6 | trillianjedi | 5:55 pm July 28, 2003 | ||||
| Another one banned |
7 | cyberkat | 2:40 pm July 28, 2003 | ||||
| Typical spider activity beginner's question |
2 | Mr_Busby | 3:26 am July 28, 2003 | ||||
| WebTV and Verio |
5 | wilderness | 4:10 am July 27, 2003 | ||||
| why are spiders bad? sorry if this is a rookie question |
12 | SammiGirl | 12:33 am July 27, 2003 | ||||
| Fake GoogleBot? Korean NaverRobot bot masking as "GoogleBot" |
6 | Romeo | 3:57 pm July 26, 2003 | ||||
| Fake Dynamic IP changing continusly Robot with Dynamic changing IP |
3 | nilloc | 3:13 pm July 26, 2003 | ||||
| Any ideas: arirang_check What is it? |
3 | animator | 5:13 pm July 25, 2003 | ||||
| Flash Processor Anyone has seen this spider? |
2 | bilalak | 5:42 am July 25, 2003 | ||||
| New COMBINE spider detected Ban this spider |
2 | Digger | 2:52 pm July 24, 2003 | ||||
| MediaPartners spider Ban this one |
2 | Digger | 7:42 pm July 23, 2003 | ||||
| Gaisbot/3.0 info? |
5 | coyote | 10:43 am July 23, 2003 | ||||
| he is back look UE - Mediapartners-Google/2.1 he is back look UE - Mediapartners-Google/2.1 |
2 | StopSpam | 10:22 pm July 22, 2003 | ||||
| An aggressive spider - does anyone know it? |
6 | mrdch | 6:15 pm July 22, 2003 | ||||
| MSIE Crawler More information requested |
3 | loanuniverse | 4:08 pm July 22, 2003 | ||||
| Google and WAP |
6 | wilderness | 3:05 am July 22, 2003 | ||||
| who/what does mozilla stand for |
12 | Blelisa | 8:08 pm July 21, 2003 |
