Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

We can put sitempp.html to robots.txt?

need some advise

2:37 pm on Jul 5, 2007 (gmt 0)

New User

10+ Year Member

joined:Dec 30, 2004
votes: 0

We can make sitemap.xml put to robots.txt, but I don't know we can put other name or other format put ot robots.txt?

Thank you

12:00 pm on July 6, 2007 (gmt 0)

Administrator from US 

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:June 21, 2004
votes: 243

Robots.txt is a specific format that is explained here [robotstxt.org....] Some search engines have made exceptions and will allow robots.txt to do things that are not officially allowed.

One example of an unofficial part of robots.txt that will work with search engines is placing the url of the sitemap file in the robots.txt file. A few search engines will follow that url to the sitemap. You should not include the actual sitemap data, only include the sitemap url.

I hope that helps you. Please let me know if you have another question.