- - Search Engines
- -- Sitemaps, Meta Data, and robots.txt
- ---- Robots.txt
sem4u - 2:26 pm on Jul 23, 2013 (gmt 0)
The filename must be called robots.txt to be crawled by Google and other search engines. Copy the content of the other file to robots.txt and delete the other one.
Thread source: http://www.webmasterworld.com/robots_txt/4595957.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com