Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| How to report a potential Bot abuse? Would love to have one in my draft folder just in case ;) |
2 | hanuman | 4:15 pm June 14, 2002 | ||||
| Reading robots.txt or root directory, then leaving |
3 | Bluestreak | 4:02 pm June 14, 2002 | ||||
| New company Name Any Ideas for our new company name? |
2 | canucks1980 | 8:07 pm June 13, 2002 | ||||
| New Ink Spider |
5 | fiestagirl | 4:09 pm June 12, 2002 | ||||
| Dbrowse 1.4b, RSurf, PEval what are they? |
8 | Jaf | 3:38 pm June 12, 2002 | ||||
| Proper syntax for banning bad bots in htaccess using mod_rewrite and htaccess commands correctly for banning bad bots |
8 | Bluestreak | 2:42 pm June 12, 2002 | ||||
| Mysterious User Agent is random string , AQJPTSIP, e.g. Anybody know what kind of masking agent is being used and why? |
8 | nonprof_webguy | 2:04 pm June 12, 2002 | ||||
| List of user agents |
2 | dang4 | 8:57 am June 11, 2002 | ||||
| puf/0.91beta6a Has this robot harmed anyone? |
4 | misosoph | 6:17 am June 11, 2002 | ||||
| Spider Identificatioon script How many visits from googlebot ? Referals ? etc.. |
2 | Thierry_Zoller | 9:53 am June 10, 2002 | ||||
| Inktomi Random Agent header ? MonkeysNuts/5.01 [Its the dogs) |
3 | Thierry_Zoller | 9:46 am June 10, 2002 | ||||
| Yet more Alavaista User-Agents When will ever stop making new ones? |
2 | Josk | 9:45 am June 10, 2002 | ||||
| Fast WebCrawler 3.6 Is this new? |
4 | coconutz | 6:27 pm June 9, 2002 | ||||
| 66.150.40.220 Can anyone identify it? |
5 | Birdman | 11:25 am June 9, 2002 | ||||
| FirstGov.gov Search - POC:firstgov.webmasters@gsa.gov Is this for real? |
5 | Key_Master | 5:15 am June 9, 2002 | ||||
| Snoopy_v0.1 |
4 | korkus2000 | 3:34 pm June 5, 2002 | ||||
| BlitzBOT@tricus.net ? |
3 | bull | 3:54 pm June 4, 2002 | ||||
| 65.24.37.57 - toto toto? - no referrer, no ua |
6 | misosoph | 4:32 am June 4, 2002 | ||||
| Unwanted Spiders - how to limit/kill access simple ways to code, spiders list etc. |
3 | lak12 | 7:56 pm June 3, 2002 | ||||
| scooter/1.0 (netscan.fr) Is this Alta Vista? |
3 | volatilegx | 5:51 pm June 3, 2002 | ||||
| Monitoring bot activity with a script? |
8 | Bluestreak | 1:00 am June 3, 2002 | ||||
| autoemailspider email harvester or poorly named spider? |
3 | zem | 12:48 am June 2, 2002 | ||||
| DiaGem Another bot to ban |
6 | Son_House | 6:03 am June 1, 2002 | ||||
| 216.200.130.207 Ask Jeeves Spider? |
3 | Key_Master | 7:15 pm May 31, 2002 | ||||
| new google spider IP? 64.95.79.195 |
5 | chiefmonkey | 5:44 pm May 31, 2002 |
