homepage Welcome to WebmasterWorld Guest from 54.145.172.149
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
more colo's
wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4443699 posted 12:13 pm on Apr 21, 2012 (gmt 0)

Robots text, not sure why as there's no ID in the UA.
Root twice and two pages.

Database by Design, LLC DBDLLC-PHL-401 199.187.120.0 - 199.187.127.255
Ade Rosa Kurniawan DBDLLC-PHL-401 199.187.122.96 - 199.187.122.103
199.187.122.98 - - [21/Apr/2012:07:05:20 +0100] "GET /robots.txt HTTP/1.1" 200 2627 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)"

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4443699 posted 4:37 pm on Apr 21, 2012 (gmt 0)

Cyber Wurx LLC CONEPUPPY-COM (NET-66-154-0-0-1) 66.154.0.0 - 66.154.95.255
Cyber Wurx NET-66-154-0-0-18 (NET-66-154-0-0-2) 66.154.0.0 - 66.154.63.255
66.154.33.56 - - [21/Apr/2012:16:47:52 +0100] "GET / HTTP/1.1" 403 533 "-" "-"

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4443699 posted 12:39 am on Apr 22, 2012 (gmt 0)

Robots text, not sure why as there's no ID in the UA.

Are you asking why they behaved like a Good Robot even though they're wearing plain clothes? Stranger things have happened :)

keyplyr

WebmasterWorld Senior Member keyplyr us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4443699 posted 1:14 am on Apr 22, 2012 (gmt 0)

Shopping list

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4443699 posted 1:56 am on Apr 22, 2012 (gmt 0)

Are you asking why they behaved


It was rhetorical.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved