homepage Welcome to WebmasterWorld Guest from 54.167.10.244
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification

Search Engine Spider and User Agent Identification

Forum Charter, Library, Moderated by: Ocean10000 & incrediBILL Forum Options: Reset Last Read Pointers

PreModerated forum to id search engine spiders

 
new Subject Messages Started by Last Message
newpost thread iconMicrosoft- really?
  IP indicates microsoft, UA is strange
4dupres01 8:23 pm on Dec 13, 2012 (gmt 0)
newpost thread iconCloaked yahoo crawler
 
6Bewenched 5:41 am on Dec 12, 2012 (gmt 0)
newpost thread iconQippoBot/1.4+(+http://www.qippo.com/bot/)[2] ( 1 2 )
 
34Bewenched 7:31 am on Dec 11, 2012 (gmt 0)
newpost thread iconDomainVader/1.0
 
3MxAngel 9:42 pm on Dec 10, 2012 (gmt 0)
newpost thread iconwhat is msnbot-media 1.1 - Beware
  spyware?
1snowleopard 12:42 pm on Dec 9, 2012 (gmt 0)
newpost thread iconCityGrid.com URL Validation
  107.22.0.185
7Bewenched 8:28 pm on Dec 6, 2012 (gmt 0)
newpost thread iconfindlinks bot
  130.83.167.153
4Bewenched 8:00 am on Dec 4, 2012 (gmt 0)
newpost thread iconGrapeshotCrawler
  89.145.95.2
1Bewenched 5:19 am on Dec 4, 2012 (gmt 0)
newpost thread iconYasni
 
10incrediBILL 3:03 pm on Dec 3, 2012 (gmt 0)
newpost thread iconSite Rating System
 
3Ken_S 2:22 am on Dec 3, 2012 (gmt 0)
newpost thread iconChinaCache North America
 
17incrediBILL 8:57 pm on Dec 1, 2012 (gmt 0)
newpost thread iconDefinitive Sources of IP Lists
 
9incrediBILL 8:42 pm on Dec 1, 2012 (gmt 0)
newpost thread iconMore virtual servers
  Linode Cloud
7Bewenched 9:31 pm on Nov 30, 2012 (gmt 0)
newpost thread iconInteresting visit from Google
  Merchant Center?
3Bewenched 8:41 pm on Nov 29, 2012 (gmt 0)
newpost thread iconAmazon+Image+Cache/0.5+libwww-perl/5.808
  72.21.217.3
1Bewenched 7:36 am on Nov 28, 2012 (gmt 0)
newpost thread iconRogue .pdf grabber
  85.73.112.xx
5Bewenched 3:44 pm on Nov 27, 2012 (gmt 0)
newpost thread iconBig Fluffy Cloud
  cloud servers that is
5Bewenched 2:25 am on Nov 27, 2012 (gmt 0)
newpost thread iconMore Chinanet[2] ( 1 2 )
  119.128.0.0
36not2easy 7:29 pm on Nov 26, 2012 (gmt 0)
newpost thread iconphoney Hungarian bingbot
  UA claims bingbot
1dupres01 6:14 pm on Nov 26, 2012 (gmt 0)
newpost thread iconGET Request
 
6Ken_S 10:03 pm on Nov 25, 2012 (gmt 0)
newpost thread icon76.74.153.xx
  no robots.txt , blank user agent
10Bewenched 8:21 pm on Nov 25, 2012 (gmt 0)
newpost thread iconOngoing ia archiver Abuse From China
 
4incrediBILL 6:52 pm on Nov 25, 2012 (gmt 0)
newpost thread iconAttemped hacker
  out of an aol range
1Bewenched 5:57 pm on Nov 25, 2012 (gmt 0)
newpost thread iconGumGum Bot
  107.22.108.63
1Bewenched 8:08 am on Nov 25, 2012 (gmt 0)
newpost thread iconfilterdb.iss.net/crawler/
  194.153.113.35
6Bewenched 11:38 pm on Nov 24, 2012 (gmt 0)
Displaying Page 12 of 215<< Back 1 ... 2 3 4 5 6 7 8 9 10 11 [ 12 ] 13 14 15 16 17 18 19 20 21 ... 215 Next >>
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved