- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- What if your domains robots.txt
Daily_Sparring - 2:47 am on Sep 27, 2004 (gmt 0)
if it was done with a mod rewrite, would that affect the bots ability to spider or crawl.
Thread source: http://www.webmasterworld.com/robots_txt/449.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com