Page is a not externally linkable
- WebmasterWorld
-- New To Web Development
---- Robot.txt and logs

JamesR - 8:20 pm on Jul 24, 2002 (gmt 0)


Hi madcat,

Here is the definitive site for the robots.txt [robotstxt.org]

I like FastStats from Mach5 software for reading log info.

Thread source:: http://www.webmasterworld.com/new_web_development/31.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com