Welcome to WebmasterWorld Guest from 54.161.135.168

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
U of Cal
Santa Barbara
9 wilderness 11:19 am Feb 4, 2013
BingBot Fake
19 Ken_S 3:45 am Feb 4, 2013
Yandex gets fatter
13 lucy24 9:57 pm Feb 1, 2013
the latest impenetrable disguise
[2] ( 1 2 )
40 lucy24 3:47 am Jan 30, 2013
goo goo GET GET
8 lucy24 7:50 am Jan 27, 2013
Filtering Out Really Hard To Find Bad Bots
26 incrediBILL 2:16 am Jan 24, 2013
ZTE-Z431/1.4.0 NetFront/4.2 QTV5.1 User-Agent
Profile/MIDP-2.1 Configuration/CLDC-1.1
4 not2easy 9:24 pm Jan 23, 2013
strange g-refers
1 wilderness 5:41 pm Jan 22, 2013
WBSearchBot misbehaving
12 incrediBILL 12:11 am Jan 19, 2013
LLF user agent
1 Ken_S 6:32 pm Jan 18, 2013
MSOffice 12
What were they thinking?
1 blend27 5:54 pm Jan 18, 2013
and another gets on.
5 lucy24 1:25 pm Jan 18, 2013
Lots of interesting user agents
4 Bewenched 7:54 pm Jan 15, 2013
Baidu's IPs - Which Are Legit?
12 incrediBILL 7:21 pm Jan 13, 2013
LSSRocketCrawler/1.0 LightspeedSystems
69.84.207.246
3 Bewenched 5:57 pm Jan 13, 2013
sitemap.xml requests
3 wilderness 12:38 am Jan 13, 2013
Tiscali Communicator (scraper)
on SteepHost (Ukraine)
3 not2easy 9:22 pm Jan 12, 2013
Could someone spare a set of Anti-AWS (and other offenders) CSF rules?
2 1script 8:45 am Jan 12, 2013
Are these considered as bad bots ?
23 pkKumar 3:00 am Jan 11, 2013
msn bot has gone crazy
15 bwnbwn 10:52 pm Jan 9, 2013
Apple
6 wilderness 2:19 am Jan 9, 2013
browser versions
3 wilderness 1:39 am Jan 9, 2013
Netscape
5 wilderness 10:15 pm Jan 8, 2013
Entanet
Entanet-adsl
2 not2easy 10:05 pm Jan 8, 2013
Undefined Error in Logs
[2] ( 1 2 )
39 yaashul 5:28 am Jan 7, 2013

Featured Threads

Hot Threads This Week

Hot Threads This Month