Forum Moderated by: open
Forum to identify search engine spiders and user agents
| Thread Subject | Messages | Started by | Last Message | ||||
|---|---|---|---|---|---|---|---|
| SEOmoz Crawler/Bot [2] ( 1 2 ) |
49 | g1smd | 9:20 pm Oct 29, 2008 | ||||
| Slurp now fetching CSS Is this a new behavior? |
3 | jdMorgan | 5:13 pm Oct 28, 2008 | ||||
| MSN Live |
2 | wilderness | 3:44 pm Oct 28, 2008 | ||||
| GoogleT5 |
5 | keyplyr | 1:44 pm Oct 21, 2008 | ||||
| Bots find new domain in days robot/scrape activity before there's a site |
9 | dstiles | 5:19 pm Oct 20, 2008 | ||||
| Why is there no mention of BotBuster on WW? Good or bad, there should be some mention, right? |
15 | MichaelBluejay | 12:26 am Oct 17, 2008 | ||||
| Webmaster World Websensed Websense is blocking access to webmasterworld.com for many corporate users. |
2 | spotter | 11:32 pm Oct 15, 2008 | ||||
| Slurp is turning bad. |
7 | waynne | 11:19 pm Oct 15, 2008 | ||||
| Cuil |
9 | ning | 9:59 am Oct 15, 2008 | ||||
| itsapic.com crawler |
6 | keyplyr | 3:41 pm Oct 14, 2008 | ||||
| #*$!Bot |
2 | keyplyr | 1:51 am Oct 12, 2008 | ||||
| nrsbot |
5 | wilderness | 7:21 pm Oct 11, 2008 | ||||
| fake Google |
9 | wilderness | 3:56 am Oct 11, 2008 | ||||
| Leon |
2 | keyplyr | 7:06 pm Oct 4, 2008 | ||||
| HPAutoRun |
3 | keyplyr | 12:41 am Oct 3, 2008 | ||||
| Yahoo Python Yahoo using a common site scraper |
6 | dstiles | 10:06 pm Oct 1, 2008 | ||||
| Bluecoat - good or bad? Bluecoat sometimes seems to be a baddie |
4 | dstiles | 3:32 pm Oct 1, 2008 | ||||
| Gotta love this one from Amazon They'll stop crawling depending on my attitude! |
4 | GaryK | 2:32 am Oct 1, 2008 | ||||
| New Wave of SQL Injection Vulnerability Probes List of sites being compiled for future attacks[2] ( 1 2 ) |
45 | smokeybarnable | 9:36 pm Sept 29, 2008 | ||||
| crawly 2.6.3 |
2 | keyplyr | 1:43 pm Sept 29, 2008 | ||||
| Mozilla/4.0 (PSP (PlayStation Portable); 2.00) Novarra-Vision/7.3 More crap from Yahoo? |
6 | GaryK | 10:09 pm Sept 28, 2008 | ||||
| MSN/Live MSMOBOT User-agent string change User-agent string changed |
5 | jdMorgan | 7:58 am Sept 28, 2008 | ||||
| Google Chrome UA Covered in Apple Sauce |
6 | incrediBILL | 6:02 pm Sept 25, 2008 | ||||
| Netdirect-net When will this stop? |
3 | blend27 | 1:30 am Sept 23, 2008 | ||||
| UA Grazr/v2.0 this bot is crawling my site |
6 | susanrb | 2:33 am Sept 22, 2008 |
