Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| MSN/Live MSMOBOT User-agent string change User-agent string changed |
5 | jdMorgan | 7:58 am Sept 28, 2008 | ||||
| Google Chrome UA Covered in Apple Sauce |
6 | incrediBILL | 6:02 pm Sept 25, 2008 | ||||
| Netdirect-net When will this stop? |
3 | blend27 | 1:30 am Sept 23, 2008 | ||||
| UA Grazr/v2.0 this bot is crawling my site |
6 | susanrb | 2:33 am Sept 22, 2008 | ||||
| Yahoo! Verifier Yet another Yahoo robot |
11 | jdMorgan | 8:33 pm Sept 19, 2008 | ||||
| baiduspider indexing like crazy How to limit the crawling speed |
3 | mainspot | 6:02 am Sept 19, 2008 | ||||
| Firebat 2.8.2 what's this? |
2 | smallcompany | 1:46 pm Sept 18, 2008 | ||||
| bsalsa for beginners |
8 | Samizdata | 12:22 am Sept 15, 2008 | ||||
| +QQDownload+1.7 Any idea what this is |
4 | Vimes | 11:35 pm Sept 12, 2008 | ||||
| Whitevector Crawler |
16 | vordmeister | 11:21 pm Sept 12, 2008 | ||||
| What is DoCoMo/1.0/N505i/c20/TB/W20H10 ? |
8 | gringogigi | 4:45 pm Sept 12, 2008 | ||||
| WebAlta Crawler |
18 | keyplyr | 12:29 am Sept 12, 2008 | ||||
| Nessus::soap huh? |
2 | Bewenched | 3:59 am Sept 11, 2008 | ||||
| Java in User Agent Is it safe to block? |
12 | smallcompany | 1:22 pm Sept 8, 2008 | ||||
| Mozilla/5.0 (compatible; BMC/1.0 (Y!J-AGENT)) |
3 | GaryK | 3:50 am Sept 8, 2008 | ||||
| GoogleEarth |
3 | wilderness | 3:47 am Sept 8, 2008 | ||||
| DotBot |
6 | keyplyr | 11:49 pm Sept 4, 2008 | ||||
| MSIE 7 prefetch XP and Vista prefetch with MSIE 7 |
4 | dstiles | 9:33 pm Sept 3, 2008 | ||||
| msnbot crawling with massive binary strings in URIs appears to be some buffer overflow vulnerability |
3 | incrediBILL | 11:15 pm Aug 27, 2008 | ||||
| Google Toolbar as Spider What should be returned? |
2 | dstiles | 5:15 pm Aug 27, 2008 | ||||
| UAs with a space *before* a semi-colon New spider/somethingorother? |
6 | Pfui | 1:19 am Aug 27, 2008 | ||||
| libwww-perl/5.812 |
6 | wilderness | 3:05 am Aug 26, 2008 | ||||
| fdfdkll.html Google gone crazy? |
5 | phred | 12:39 pm Aug 25, 2008 | ||||
| AOL toolbar? What is ee://aol/http |
11 | dstiles | 8:51 pm Aug 21, 2008 | ||||
| Accelovation |
2 | Bewenched | 9:12 am Aug 20, 2008 |
