Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- I am writing my 1st robots.txt :) - never bothered before

diddlydazz - 3:45 am on Jan 12, 2002 (gmt 0)


I am writing my 1st robots.txt :)

Never really had a need to before.

Anyone know any crawlers I should add ??

Thanks !!

Dazz

Thread source:: http://www.webmasterworld.com/robots_txt/129.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com