Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Lite Bot 0616B Ver numbers decreasing? |
3 | MarieC | 6:54 pm Mar 17, 2003 | ||||
| 216.191.20.26 |
3 | Brett_Tabke | 6:23 pm Mar 17, 2003 | ||||
| lachesis spider from Japan (Nara province) lachesis spider from Japan (Nara province) |
5 | misslulu | 2:10 pm Mar 17, 2003 | ||||
| PlantyNet_WebRobot_V1.9 Has anyone seen this? |
2 | MarieC | 12:26 pm Mar 16, 2003 | ||||
| obot spidered by 5 day old site |
3 | coffeelover | 9:11 am Mar 16, 2003 | ||||
| T-h-u-n-d-e-r-s-t-o-n-e Anyone know about this one? |
11 | pendanticist | 5:14 am Mar 16, 2003 | ||||
| 4 | StanTheMan | 7:28 pm Mar 15, 2003 | |||||
| Anyone know about UA: Datum/0.1 coming from IPs with a web server |
2 | acronym | 6:40 pm Mar 15, 2003 | ||||
| k2spider new UA coming out of Glaxo? |
2 | acronym | 7:15 am Mar 15, 2003 | ||||
| psbot/0.1 Anyone else getting hit by it? picsearch bot |
6 | Alphawolf | 2:17 am Mar 15, 2003 | ||||
| FAST-WebCrawler/3.7/FirstPage What does it do? |
5 | oLeon | 12:20 am Mar 15, 2003 | ||||
| Spider From China : Dynegy-communication SPIDER FROM CHINA : Zeus 2.6 |
2 | misslulu | 6:38 pm Mar 14, 2003 | ||||
| file vs directory better optimization |
2 | tthach2 | 5:41 am Mar 14, 2003 | ||||
| Turnititbot google spam reporting.....Nah |
5 | eljefe3 | 2:59 am Mar 14, 2003 | ||||
| lachesis spider form Japan (Nara province) lachesis spider form Japan (Nara province) |
4 | misslulu | 12:58 am Mar 14, 2003 | ||||
| Php/4.0.6 Double Calls for pages, with brief pause in between requests. |
3 | pendanticist | 6:20 am Mar 13, 2003 | ||||
| WebClippings old thread |
2 | wilderness | 5:05 am Mar 13, 2003 | ||||
| UA of major Search Engines made list of major UA serach engines |
3 | StopSpam | 7:50 pm Mar 12, 2003 | ||||
| Naverbot seems to have changed Possibel variant Taking big bites Now |
5 | carfac | 7:11 pm Mar 12, 2003 | ||||
| ctechld.com log spamming? |
5 | jazzguy | 2:42 am Mar 12, 2003 | ||||
| Kapere New(ish) site grabber? |
2 | ritch_b | 1:18 am Mar 12, 2003 | ||||
| TECOMAC-Crawler/0.4 Doing a very deep crawl |
5 | warry | 12:19 am Mar 12, 2003 | ||||
| 6 bots left... What's the safest identification method? |
8 | menyak | 8:36 pm Mar 11, 2003 | ||||
| "Phantom" bot help in identifying invisible bot |
4 | bobmark | 3:58 pm Mar 11, 2003 | ||||
| Fake bot spotted using Googlebot agent name |
12 | jcoronella | 2:59 pm Mar 11, 2003 |
