Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| NCSA_Beta_1 The Supercomputer is after me! |
3 | bcolflesh | 4:48 am Apr 5, 2003 | ||||
| Cloaked Spider!? ...something strange went through my site! |
3 | frogg | 12:41 am Apr 4, 2003 | ||||
| WebCopier v2.8a |
10 | madmatt69 | 8:27 pm Apr 3, 2003 | ||||
| Google Confused? Is my site messing with google? |
3 | Skylo | 7:01 pm Apr 2, 2003 | ||||
| New Sighting: NexaBot/1.0 213.173.191.108 |
3 | skirril | 6:59 pm Apr 2, 2003 | ||||
| Msie 5.5 Msie 5.5 Spam |
13 | Andrue | 11:23 am Apr 2, 2003 | ||||
| openfind outdated threads |
2 | wilderness | 3:03 pm Apr 1, 2003 | ||||
| Badly-written spider Possibly using open .CA proxies |
2 | jdMorgan | 6:45 pm Mar 31, 2003 | ||||
| Filtering bots from traffic reports Agent name and/or IP address? |
6 | aspdaddy | 6:45 pm Mar 31, 2003 | ||||
| WebCapture Is this a bot? |
2 | copongcopong | 2:04 am Mar 28, 2003 | ||||
| "Generic" 128.255.244.82 |
2 | DavidT | 9:16 pm Mar 27, 2003 | ||||
| colocation |
3 | wilderness | 6:03 pm Mar 27, 2003 | ||||
| What's This? AOLserver-Tcl/3.3.1+ad13 |
3 | Oaf357 | 12:40 am Mar 27, 2003 | ||||
| When should I disable sessions? |
5 | Tonearm | 6:07 pm Mar 26, 2003 | ||||
| semanticdiscovery/0.1 A new information harvester |
18 | jdMorgan | 3:47 pm Mar 26, 2003 | ||||
| Another Japanese Bot: Aruyo/0.01 Just grabbed robots.txt |
2 | carfac | 7:27 am Mar 25, 2003 | ||||
| Unknown user agents that appear to be bots - valid spiders or proxies? Unknown user agents that appear to be bots - valid spiders or proxies? |
2 | FoodPlaces | 5:55 am Mar 25, 2003 | ||||
| Who's looking at my pages Is this a search engine? |
2 | Roscoe | 9:46 pm Mar 23, 2003 | ||||
| New Heavy Use Spider? 1900 pages + |
2 | Blade | 10:29 pm Mar 22, 2003 | ||||
| I need a new program to parse out my logs. Not satisfied with the reports I am getting |
7 | juniperwasting | 11:18 pm Mar 21, 2003 | ||||
| NetRatings / 64.124.34.46 Generating a lot of 404s |
4 | pallo | 11:13 pm Mar 21, 2003 | ||||
| Intelliseek brand protection robot |
7 | ScottMcG | 5:54 pm Mar 21, 2003 | ||||
| Black Widow Web Crawler Something to watch out for? |
5 | MarieC | 2:09 pm Mar 21, 2003 | ||||
| AmfibiBOT what is it? |
7 | khillman | 6:08 pm Mar 20, 2003 | ||||
| Current verified SPAM-bots User-agents and IP's |
4 | Orange_XL | 9:23 am Mar 20, 2003 |
