homepage Welcome to WebmasterWorld Guest from 54.205.241.107
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
ProCog Coming Soon!
in 27 days...
incrediBILL

WebmasterWorld Administrator incredibill us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4477748 posted 7:30 am on Jul 21, 2012 (gmt 0)

64.22.106.82

Mozilla/5.0 (compatible; ProCogBot/1.0; +http://www.procog.com/spider.html)

ROBOTS.TXT: YES/NO - asked and ignored

Stumbled across this one because it behaved badly and ignored being told to go away and went for the index page regardless.

Supposedly going live in less than 30 days according to the home page, should be interesting to see what they're doing.

 

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4477748 posted 8:01 am on Jul 21, 2012 (gmt 0)


Range blocked for bad bots

Global Net dedicated servers
64.22.64.0 - 64.22.127.255
64.22.64.0/18

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved