- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- robots.txt - disallow any url containing.
BrainDed - 10:28 pm on May 18, 2011 (gmt 0)
Wow... thats over my head. Thank you though!
Should I start a new topic in this section, [webmasterworld.com...] , with this info as we have strayed away from robots.txt?
Thread source: http://www.webmasterworld.com/robots_txt/4314267.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com