- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Using Wildcat
ThomasB - 5:13 pm on Jul 6, 2008 (gmt 0)
This should work for Google, but others, like Yahoo might have problems and it will most probably not work. Reason is, that this is not standardized robots.txt code.
Thread source: http://www.webmasterworld.com/robots_txt/3686336.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com