Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| Yahoo! Verifier Yet another Yahoo robot |
11 | jdMorgan | 8:33 pm Sep 19, 2008 | ||||
| baiduspider indexing like crazy How to limit the crawling speed |
3 | mainspot | 6:02 am Sep 19, 2008 | ||||
| Firebat 2.8.2 what's this? |
2 | smallcompany | 1:46 pm Sep 18, 2008 | ||||
| bsalsa for beginners |
8 | Samizdata | 12:22 am Sep 15, 2008 | ||||
| +QQDownload+1.7 Any idea what this is |
4 | Vimes | 11:35 pm Sep 12, 2008 | ||||
| Whitevector Crawler |
16 | vordmeister | 11:21 pm Sep 12, 2008 | ||||
| What is DoCoMo/1.0/N505i/c20/TB/W20H10 ? |
8 | gringogigi | 4:45 pm Sep 12, 2008 | ||||
| WebAlta Crawler |
18 | keyplyr | 12:29 am Sep 12, 2008 | ||||
| Nessus::soap huh? |
2 | Bewenched | 3:59 am Sep 11, 2008 | ||||
| Java in User Agent Is it safe to block? |
12 | smallcompany | 1:22 pm Sep 8, 2008 | ||||
| Mozilla/5.0 (compatible; BMC/1.0 (Y!J-AGENT)) |
3 | GaryK | 3:50 am Sep 8, 2008 | ||||
| GoogleEarth |
3 | wilderness | 3:47 am Sep 8, 2008 | ||||
| DotBot |
6 | keyplyr | 11:49 pm Sep 4, 2008 | ||||
| MSIE 7 prefetch XP and Vista prefetch with MSIE 7 |
4 | dstiles | 9:33 pm Sep 3, 2008 | ||||
| msnbot crawling with massive binary strings in URIs appears to be some buffer overflow vulnerability |
3 | incrediBILL | 11:15 pm Aug 27, 2008 | ||||
| Google Toolbar as Spider What should be returned? |
2 | dstiles | 5:15 pm Aug 27, 2008 | ||||
| UAs with a space *before* a semi-colon New spider/somethingorother? |
6 | Pfui | 1:19 am Aug 27, 2008 | ||||
| libwww-perl/5.812 |
6 | wilderness | 3:05 am Aug 26, 2008 | ||||
| fdfdkll.html Google gone crazy? |
5 | phred | 12:39 pm Aug 25, 2008 | ||||
| AOL toolbar? What is ee://aol/http |
11 | dstiles | 8:51 pm Aug 21, 2008 | ||||
| Accelovation |
2 | Bewenched | 9:12 am Aug 20, 2008 | ||||
| AVG Stops Real-Time Scanning Webmasters Complain AVG Debilitating Traffic Analytics[2] ( 1 2 ) |
39 | Cyclob | 9:52 pm Aug 17, 2008 | ||||
| Unusual UA |
4 | wilderness | 9:51 pm Aug 17, 2008 | ||||
| Scout |
14 | wilderness | 3:10 pm Aug 17, 2008 | ||||
| YebolBot |
2 | wilderness | 4:47 pm Aug 16, 2008 |
