Welcome to WebmasterWorld Guest from 54.204.100.232

Forum Moderators: goodroi

Message Too Old, No Replies

How to validate robots.txt on "https" site?

Please help me validate my "https" site

   
10:39 pm on May 19, 2004 (gmt 0)

10+ Year Member



Hi,

The Validators I've seen so far (including one on this website) can check "http" sites but not "https" sites. I need to validate my robots.txt which is on a "https" site. Any ideas?

Thanks.

12:29 am on May 20, 2004 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Either find (buy) a tool that can do it, or copy your robots.txt file to an http server to validate it. Most of these validators are syntax checkers only, so it won't matter that the pages the file refers to don't exist.

Usually, you can call the file anything you want and place it in any directory you like as well, because the validators expect you to validate a robots exclusion file before you actually name it robots.txt and put in on-line by doing so.

Jim