Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| UA simply "Mozilla" ...and a question |
6 | coyote | 5:41 am Nov 1, 2003 | ||||
| Ocelli/1.0 Hit site 122 times - cannot find in records |
2 | vincevincevince | 1:39 am Nov 1, 2003 | ||||
| sv-fw.looksmart.com |
5 | addvisors | 7:54 pm Oct 31, 2003 | ||||
| Microsoft-WebDAV-MiniRedir/5.1.2600 148,000 hits from the above, but what is it? |
4 | creepychris | 12:30 pm Oct 31, 2003 | ||||
| Scooter |
5 | Vermont | 9:02 am Oct 31, 2003 | ||||
| 3 | BlueSky | 5:55 am Oct 31, 2003 | |||||
| Slurp - Very odd requests requesting pages that dont exist |
5 | highman | 8:22 am Oct 30, 2003 | ||||
| 24.153.166.189 fell in bot trap |
2 | coyote | 2:40 am Oct 30, 2003 | ||||
| JScript Processor - tool or bot? |
4 | keyplyr | 1:36 pm Oct 29, 2003 | ||||
| User-agent with ....../1.0? Mozilla/4.0 (compatible; MSIE 4.0; Windows NT; ....../1.0 ) |
6 | seindal | 12:52 pm Oct 29, 2003 | ||||
| Email Spider by AlexW |
6 | BlueSky | 11:17 pm Oct 28, 2003 | ||||
| Newbie question about lack of spiders to recently optimized pages |
4 | lawboy | 11:16 pm Oct 28, 2003 | ||||
| Vsecrawler@hotmail.com? Crawling Sites What is This? Any Insights Appreciated |
3 | COlarry | 7:57 pm Oct 28, 2003 | ||||
| Bots ignoring Session IDs How to set Session IDs to ignore bots |
3 | chavezr | 6:45 pm Oct 27, 2003 | ||||
| DickBlick |
3 | RammsteinNicCage | 2:09 am Oct 27, 2003 | ||||
| 69.61.12.100 colocation |
3 | coyote | 12:28 am Oct 27, 2003 | ||||
| 212.142.33.101 -- sprung bot trap |
3 | BlueSky | 12:25 am Oct 27, 2003 | ||||
| Java/1.x.y Bot or not? |
7 | WebJoe | 9:58 am Oct 26, 2003 | ||||
| Anybody know what this is Jakarta Commons-HttpClient/2.0rc1 |
7 | StanTheMan | 10:07 am Oct 25, 2003 | ||||
| kuloko-bot with hidden hostname coming from "." -- very funny |
3 | Romeo | 8:20 pm Oct 24, 2003 | ||||
| Scooter/3.2 doing weird things on my site What is this all about? |
2 | kewlbeezer | 6:21 pm Oct 24, 2003 | ||||
| blocking visitors but not search engines |
2 | jakob77 | 5:57 pm Oct 24, 2003 | ||||
| Session IDs Session IDs or not |
2 | chavezr | 4:08 pm Oct 24, 2003 | ||||
| Msnia New? |
4 | ganderla | 5:00 am Oct 24, 2003 | ||||
| voilabot beta 1.2 need to ban, but don't see reques for robots.txt |
4 | macrost | 9:02 pm Oct 23, 2003 |
