Welcome to WebmasterWorld Guest from 54.196.144.100

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
ChinaCache North America
17 incrediBILL 8:57 pm Dec 1, 2012
Definitive Sources of IP Lists
9 incrediBILL 8:42 pm Dec 1, 2012
More virtual servers
Linode Cloud
7 Bewenched 9:31 pm Nov 30, 2012
Interesting visit from Google
Merchant Center?
3 Bewenched 8:41 pm Nov 29, 2012
Amazon+Image+Cache/0.5+libwww-perl/5.808
72.21.217.3
1 Bewenched 7:36 am Nov 28, 2012
Rogue .pdf grabber
85.73.112.xx
5 Bewenched 3:44 pm Nov 27, 2012
Big Fluffy Cloud
cloud servers that is
5 Bewenched 2:25 am Nov 27, 2012
More Chinanet
119.128.0.0 [2] ( 1 2 )
36 not2easy 7:29 pm Nov 26, 2012
phoney Hungarian bingbot
UA claims bingbot
1 dupres01 6:14 pm Nov 26, 2012
GET Request
6 Ken_S 10:03 pm Nov 25, 2012
76.74.153.xx
no robots.txt , blank user agent
10 Bewenched 8:21 pm Nov 25, 2012
Ongoing ia archiver Abuse From China
4 incrediBILL 6:52 pm Nov 25, 2012
Attemped hacker
out of an aol range
1 Bewenched 5:57 pm Nov 25, 2012
GumGum Bot
107.22.108.63
1 Bewenched 8:08 am Nov 25, 2012
filterdb.iss.net/crawler/
194.153.113.35
6 Bewenched 11:38 pm Nov 24, 2012
Fake Google or code.google.com ?
89.164.163.72
8 Bewenched 10:35 pm Nov 24, 2012
Spinn3r+3.1
174.36.228.xxx
2 Bewenched 9:14 pm Nov 24, 2012
Mailru-net
stopped by snagging images only.
8 Bewenched 9:48 pm Nov 22, 2012
Netherlands blank user agent
213.206.102.103
1 Bewenched 8:37 am Nov 22, 2012
Pixray-Seeker
81.30.151.218
1 Bewenched 8:33 am Nov 22, 2012
Another odd google user agent
66.249.75.21
1 Bewenched 8:32 am Nov 22, 2012
Google crawling as an iphone
66.249.75.21
1 Bewenched 8:19 am Nov 22, 2012
Data Foundry
2 keyplyr 6:40 am Nov 21, 2012
Request for same image via various wireless networks
Mozilla/4.0, No-Referrer, Repeated 1-3 image requests
5 mslina2002 3:14 am Nov 21, 2012
headers check
10 wilderness 12:56 am Nov 21, 2012