Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Robots code


jdMorgan - 3:32 pm on Oct 4, 2002 (gmt 0)


HollyHats,

When dealing with robots.txt and similar "special files" like .htacess, the devil is in the details. If someone says "open it in Notepad" and you can't find Notepad, then it's time for another question - MSWord won't do. After you get the file created and uploaded, then use Brett's robots.txt validator [searchengineworld.com] to test it. One typo (including a missng space) in that file can cause you major problems, including being dropped from all search engines!

eBay has the best prices on the korkus2000 model, last time I checked.

But I've heard that Service Pack 1 for KorkusXP makes it much more stable, and so it might be worth the upgrade if your system is relatively recent. :)

Jim


Thread source:: http://www.webmasterworld.com/robots_txt/140.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com