Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots code


hollyhats - 5:31 pm on Oct 3, 2002 (gmt 0)


Can someone please help me to understand the following that appears in my raw access files?

209.249.67.146 -"get/robots.txt HTTP/1.0"404
64.68.82.47 -"get/robots.txt HTTP/1.0"404
64.68.82.47 -"get/HTTP/1.0"200 4872

Also, how do you know who the codes belong to? ex(209.248.67.146_


Thread source:: http://www.webmasterworld.com/robots_txt/140.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com