homepage Welcome to WebmasterWorld Guest from 54.204.249.184
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
CareerBot
keyplyr




msg:4507787
 7:00 pm on Oct 13, 2012 (gmt 0)




UA: Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)
robots.txt: yes

HostEurope
178.77.126.0 - 178.77.126.255
178.77.126.0/24

 

blend27




msg:4507843
 11:19 pm on Oct 13, 2012 (gmt 0)

HostEurope
route: 178.77.64.0/18
descr: DE-HER-178-77-64-SLASH-18
origin: AS20773
member-of: AS20773:RS-HOSTEUROPE

178.77.64.0 - 178.77.127.255

Larger Range.

The bot itself comes from .126.55, does not now what 403 means, I think there is a thread about it on WebmasterWorld already.

keyplyr




msg:4507906
 8:40 am on Oct 14, 2012 (gmt 0)

Thanks

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved