homepage Welcome to WebmasterWorld Guest from 54.81.170.186
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor
Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
We can put sitempp.html to robots.txt?
need some advise
etgsgroup




msg:3386961
 2:37 pm on Jul 5, 2007 (gmt 0)

We can make sitemap.xml put to robots.txt, but I don't know we can put other name or other format put ot robots.txt?

Thank you

 

goodroi




msg:3387649
 12:00 pm on Jul 6, 2007 (gmt 0)

Robots.txt is a specific format that is explained here [robotstxt.org....] Some search engines have made exceptions and will allow robots.txt to do things that are not officially allowed.

One example of an unofficial part of robots.txt that will work with search engines is placing the url of the sitemap file in the robots.txt file. A few search engines will follow that url to the sitemap. You should not include the actual sitemap data, only include the sitemap url.

I hope that helps you. Please let me know if you have another question.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About
© Webmaster World 1996-2014 all rights reserved