Welcome to WebmasterWorld Guest from 54.146.180.94

Forum Moderators: goodroi

We can put sitempp.html to robots.txt?

need some advise

   
2:37 pm on Jul 5, 2007 (gmt 0)

10+ Year Member



We can make sitemap.xml put to robots.txt, but I don't know we can put other name or other format put ot robots.txt?

Thank you

12:00 pm on Jul 6, 2007 (gmt 0)

WebmasterWorld Administrator goodroi is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Robots.txt is a specific format that is explained here [robotstxt.org....] Some search engines have made exceptions and will allow robots.txt to do things that are not officially allowed.

One example of an unofficial part of robots.txt that will work with search engines is placing the url of the sitemap file in the robots.txt file. A few search engines will follow that url to the sitemap. You should not include the actual sitemap data, only include the sitemap url.

I hope that helps you. Please let me know if you have another question.

 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month