Welcome to WebmasterWorld Guest from 54.205.115.177

Forum Moderated by: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification


PreModerated forum to id search engine spiders

 
Thread SubjectMessagesStarted byLast Message
Data reseller bot shortlist?
5 Sgt_Kickaxe 5:40 pm Dec 14, 2012
'artviper(tm)
85.25.9.83
8 Bewenched 8:43 pm Dec 13, 2012
Microsoft- really?
IP indicates microsoft, UA is strange
4 dupres01 8:23 pm Dec 13, 2012
Cloaked yahoo crawler
6 Bewenched 5:41 am Dec 12, 2012
QippoBot/1.4+(+http://www.qippo.com/bot/)
[2] ( 1 2 )
34 Bewenched 7:31 am Dec 11, 2012
DomainVader/1.0
3 MxAngel 9:42 pm Dec 10, 2012
what is msnbot-media 1.1 - Beware
spyware?
1 snowleopard 12:42 pm Dec 9, 2012
CityGrid.com URL Validation
107.22.0.185
7 Bewenched 8:28 pm Dec 6, 2012
findlinks bot
130.83.167.153
4 Bewenched 8:00 am Dec 4, 2012
GrapeshotCrawler
89.145.95.2
1 Bewenched 5:19 am Dec 4, 2012
Yasni
10 incrediBILL 3:03 pm Dec 3, 2012
Site Rating System
3 Ken_S 2:22 am Dec 3, 2012
ChinaCache North America
17 incrediBILL 8:57 pm Dec 1, 2012
Definitive Sources of IP Lists
9 incrediBILL 8:42 pm Dec 1, 2012
More virtual servers
Linode Cloud
7 Bewenched 9:31 pm Nov 30, 2012
Interesting visit from Google
Merchant Center?
3 Bewenched 8:41 pm Nov 29, 2012
Amazon+Image+Cache/0.5+libwww-perl/5.808
72.21.217.3
1 Bewenched 7:36 am Nov 28, 2012
Rogue .pdf grabber
85.73.112.xx
5 Bewenched 3:44 pm Nov 27, 2012
Big Fluffy Cloud
cloud servers that is
5 Bewenched 2:25 am Nov 27, 2012
More Chinanet
119.128.0.0 [2] ( 1 2 )
36 not2easy 7:29 pm Nov 26, 2012
phoney Hungarian bingbot
UA claims bingbot
1 dupres01 6:14 pm Nov 26, 2012
GET Request
6 Ken_S 10:03 pm Nov 25, 2012
76.74.153.xx
no robots.txt , blank user agent
10 Bewenched 8:21 pm Nov 25, 2012
Ongoing ia archiver Abuse From China
4 incrediBILL 6:52 pm Nov 25, 2012
Attemped hacker
out of an aol range
1 Bewenched 5:57 pm Nov 25, 2012