homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

How to validate robots.txt on "https" site?
Please help me validate my "https" site

 10:39 pm on May 19, 2004 (gmt 0)


The Validators I've seen so far (including one on this website) can check "http" sites but not "https" sites. I need to validate my robots.txt which is on a "https" site. Any ideas?




 12:29 am on May 20, 2004 (gmt 0)

Either find (buy) a tool that can do it, or copy your robots.txt file to an http server to validate it. Most of these validators are syntax checkers only, so it won't matter that the pages the file refers to don't exist.

Usually, you can call the file anything you want and place it in any directory you like as well, because the validators expect you to validate a robots exclusion file before you actually name it robots.txt and put in on-line by doing so.


Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved