Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

We can put sitempp.html to robots.txt?

need some advise



2:37 pm on Jul 5, 2007 (gmt 0)

10+ Year Member

We can make sitemap.xml put to robots.txt, but I don't know we can put other name or other format put ot robots.txt?

Thank you


12:00 pm on Jul 6, 2007 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Robots.txt is a specific format that is explained here [robotstxt.org....] Some search engines have made exceptions and will allow robots.txt to do things that are not officially allowed.

One example of an unofficial part of robots.txt that will work with search engines is placing the url of the sitemap file in the robots.txt file. A few search engines will follow that url to the sitemap. You should not include the actual sitemap data, only include the sitemap url.

I hope that helps you. Please let me know if you have another question.


Featured Threads

Hot Threads This Week

Hot Threads This Month