homepage Welcome to WebmasterWorld Guest from 54.211.138.180
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Subscribe to WebmasterWorld
Visit PubCon.com
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
more colo's
wilderness




msg:4443701
 12:13 pm on Apr 21, 2012 (gmt 0)

Robots text, not sure why as there's no ID in the UA.
Root twice and two pages.

Database by Design, LLC DBDLLC-PHL-401 199.187.120.0 - 199.187.127.255
Ade Rosa Kurniawan DBDLLC-PHL-401 199.187.122.96 - 199.187.122.103
199.187.122.98 - - [21/Apr/2012:07:05:20 +0100] "GET /robots.txt HTTP/1.1" 200 2627 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)"

 

wilderness




msg:4443767
 4:37 pm on Apr 21, 2012 (gmt 0)

Cyber Wurx LLC CONEPUPPY-COM (NET-66-154-0-0-1) 66.154.0.0 - 66.154.95.255
Cyber Wurx NET-66-154-0-0-18 (NET-66-154-0-0-2) 66.154.0.0 - 66.154.63.255
66.154.33.56 - - [21/Apr/2012:16:47:52 +0100] "GET / HTTP/1.1" 403 533 "-" "-"

lucy24




msg:4443849
 12:39 am on Apr 22, 2012 (gmt 0)

Robots text, not sure why as there's no ID in the UA.

Are you asking why they behaved like a Good Robot even though they're wearing plain clothes? Stranger things have happened :)

keyplyr




msg:4443857
 1:14 am on Apr 22, 2012 (gmt 0)

Shopping list

wilderness




msg:4443863
 1:56 am on Apr 22, 2012 (gmt 0)

Are you asking why they behaved


It was rhetorical.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved