| Welcome to WebmasterWorld Guest from 184.108.40.206 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Google Crawling Without Identification?|
3/15/2008 2:48:33 PM----220.127.116.11----/Default.asp ----Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:18.104.22.168) Gecko/2007030919 Firefox/22.214.171.124
3/15/2008 2:48:37 PM----126.96.36.199----/Default.asp ----Mozilla/5.0 (X11; U; Linux i686 (x86_64); en-US; rv:188.8.131.52) Gecko/20080201 Firefox/184.108.40.206
Today, took one page and css file, no robots.txt and no images.
Does anybody know about a specific reason as to why ?
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved