Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

How to validate robots.txt on "https" site?

Please help me validate my "https" site

10:39 pm on May 19, 2004 (gmt 0)

New User

10+ Year Member

joined:May 19, 2004
votes: 0


The Validators I've seen so far (including one on this website) can check "http" sites but not "https" sites. I need to validate my robots.txt which is on a "https" site. Any ideas?


12:29 am on May 20, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
votes: 0

Either find (buy) a tool that can do it, or copy your robots.txt file to an http server to validate it. Most of these validators are syntax checkers only, so it won't matter that the pages the file refers to don't exist.

Usually, you can call the file anything you want and place it in any directory you like as well, because the validators expect you to validate a robots exclusion file before you actually name it robots.txt and put in on-line by doing so.



Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members