Welcome to WebmasterWorld Guest from 54.166.227.36

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
JikeSpider (china)
1.202.219.5
2 Bewenched 7:13 am Oct 31, 2012
Ukranian Colocation
Utel DataCenter, Ukraine (RIPE)
3 Bewenched 6:44 am Oct 31, 2012
proximic
1 Bewenched 6:24 am Oct 31, 2012
Amazon Image Cache/0.5 libwwwperl/5.808
9 brokaddr 1:34 am Oct 31, 2012
Get Request
11 Ken_S 10:40 am Oct 27, 2012
A1colo
7 wilderness 12:20 am Oct 27, 2012
Seoanalyzer Bingbot
bingbot user agent
12 grandma_genie 12:20 am Oct 27, 2012
PowerPoint as User Agent
4 lucy24 9:21 am Oct 26, 2012
Had an interesting visitor today 173.194.73.xxx
Google? Looks like their hosting MarkMonitor
3 Bewenched 2:15 am Oct 26, 2012
Amazon bot and friends?
Possible botnet visit?
6 grandma_genie 1:32 am Oct 26, 2012
The return of Choopa
173.199.116.xxx and 173.199.114.xxx
9 Bewenched 12:41 am Oct 26, 2012
Nobis
9 keyplyr 10:16 pm Oct 25, 2012
Hetzner Online AG Data Centers
176.9.31.xx
5 Bewenched 8:13 pm Oct 25, 2012
SoftLayer/The Planet/Everyone's Internet
CIDR ranges for htaccess as of today
1 OnThePike 2:50 pm Oct 25, 2012
EGIHosting
7 keyplyr 2:42 pm Oct 25, 2012
Hurrican Electric
who are these guys
4 Bewenched 2:36 pm Oct 25, 2012
A comprehensive list of EC2 IP ranges
17 bakedjake 2:35 pm Oct 25, 2012
strange refer
6 wilderness 10:45 am Oct 24, 2012
possible botnet
15 wilderness 9:47 pm Oct 20, 2012
GG PeekBot 1.0
Gadu-gadu
1 keyplyr 7:40 pm Oct 20, 2012
the return of the ahrefsbot
8 lucy24 5:10 pm Oct 20, 2012
eSyndiCat Bot
2 keyplyr 4:10 pm Oct 20, 2012
Facebook ?
69.171.xxx.x
12 Bewenched 2:59 pm Oct 20, 2012
Google Web Preview
4 wilderness 9:33 pm Oct 18, 2012
Brand Affinity Technologies
207.38.20.0 - 207.38.20.255
3 Bewenched 9:32 pm Oct 14, 2012

Featured Threads

Hot Threads This Week

Hot Threads This Month