Welcome to WebmasterWorld Guest from 54.167.252.62

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Netherlands blank user agent
213.206.102.103
1 Bewenched 8:37 am Nov 22, 2012
Pixray-Seeker
81.30.151.218
1 Bewenched 8:33 am Nov 22, 2012
Another odd google user agent
66.249.75.21
1 Bewenched 8:32 am Nov 22, 2012
Google crawling as an iphone
66.249.75.21
1 Bewenched 8:19 am Nov 22, 2012
Data Foundry
2 keyplyr 6:40 am Nov 21, 2012
Request for same image via various wireless networks
Mozilla/4.0, No-Referrer, Repeated 1-3 image requests
5 mslina2002 3:14 am Nov 21, 2012
headers check
10 wilderness 12:56 am Nov 21, 2012
Nobis/Ubiquity
4 keyplyr 12:12 am Nov 21, 2012
what's wrong with UA
suspicious UA
6 dupres01 2:48 pm Nov 18, 2012
HiChina
5 keyplyr 3:37 am Nov 18, 2012
BeetleBot
188.207.200.116
6 Bewenched 1:47 am Nov 18, 2012
Bingbot with one domain and two IPs
What's the point of that?
10 moTi 3:18 am Nov 16, 2012
CompSpyBot
68.47.129.55
8 Bewenched 9:51 pm Nov 15, 2012
adbeat.com
174.129.111.51
2 Bewenched 10:48 pm Nov 14, 2012
Educational Unit
took 52 files - one image only - the contact image
13 Ken_S 5:17 am Nov 14, 2012
www.integromedb.org/Crawler
2 Bewenched 12:43 am Nov 14, 2012
Goodzer
1 Bewenched 10:19 pm Nov 13, 2012
the art-loving iPad
8 lucy24 6:36 pm Nov 12, 2012
TravelMap
1 keyplyr 6:22 pm Nov 12, 2012
Colocation
4 Ken_S 12:57 pm Nov 12, 2012
Mythic Beasts Test Netblock
6 keyplyr 7:57 pm Nov 11, 2012
Remote host
3 wilderness 10:53 am Nov 11, 2012
Jbot
3 keyplyr 3:03 am Nov 11, 2012
Korea KRNIC
4 Bewenched 9:23 pm Nov 10, 2012
Image thief
176.62.49.50
3 Bewenched 2:38 pm Nov 10, 2012

Featured Threads

Hot Threads This Week

Hot Threads This Month