Welcome to WebmasterWorld Guest from 54.163.68.15

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
GumGum Bot
107.22.108.63
1 Bewenched 8:08 am Nov 25, 2012
filterdb.iss.net/crawler/
194.153.113.35
6 Bewenched 11:38 pm Nov 24, 2012
Fake Google or code.google.com ?
89.164.163.72
8 Bewenched 10:35 pm Nov 24, 2012
Spinn3r+3.1
174.36.228.xxx
2 Bewenched 9:14 pm Nov 24, 2012
Mailru-net
stopped by snagging images only.
8 Bewenched 9:48 pm Nov 22, 2012
Netherlands blank user agent
213.206.102.103
1 Bewenched 8:37 am Nov 22, 2012
Pixray-Seeker
81.30.151.218
1 Bewenched 8:33 am Nov 22, 2012
Another odd google user agent
66.249.75.21
1 Bewenched 8:32 am Nov 22, 2012
Google crawling as an iphone
66.249.75.21
1 Bewenched 8:19 am Nov 22, 2012
Data Foundry
2 keyplyr 6:40 am Nov 21, 2012
Request for same image via various wireless networks
Mozilla/4.0, No-Referrer, Repeated 1-3 image requests
5 mslina2002 3:14 am Nov 21, 2012
headers check
10 wilderness 12:56 am Nov 21, 2012
Nobis/Ubiquity
4 keyplyr 12:12 am Nov 21, 2012
what's wrong with UA
suspicious UA
6 dupres01 2:48 pm Nov 18, 2012
HiChina
5 keyplyr 3:37 am Nov 18, 2012
BeetleBot
188.207.200.116
6 Bewenched 1:47 am Nov 18, 2012
Bingbot with one domain and two IPs
What's the point of that?
10 moTi 3:18 am Nov 16, 2012
CompSpyBot
68.47.129.55
8 Bewenched 9:51 pm Nov 15, 2012
adbeat.com
174.129.111.51
2 Bewenched 10:48 pm Nov 14, 2012
Educational Unit
took 52 files - one image only - the contact image
13 Ken_S 5:17 am Nov 14, 2012
www.integromedb.org/Crawler
2 Bewenched 12:43 am Nov 14, 2012
Goodzer
1 Bewenched 10:19 pm Nov 13, 2012
the art-loving iPad
8 lucy24 6:36 pm Nov 12, 2012
TravelMap
1 keyplyr 6:22 pm Nov 12, 2012
Colocation
4 Ken_S 12:57 pm Nov 12, 2012