Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- the wrong way to do robots.txt
Daniel_O - 3:43 am on Nov 3, 2003 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/192.htm
So many interesting URLs. However, every path I tried to explore turned out 404. Did anyone else experience this?
Brought to you by WebmasterWorld: http://www.webmasterworld.com