homepage Welcome to WebmasterWorld Guest from 54.166.100.8
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
How to validate robots.txt on "https" site?
Please help me validate my "https" site
CodeCrunch




msg:1525794
 10:39 pm on May 19, 2004 (gmt 0)

Hi,

The Validators I've seen so far (including one on this website) can check "http" sites but not "https" sites. I need to validate my robots.txt which is on a "https" site. Any ideas?

Thanks.

 

jdMorgan




msg:1525795
 12:29 am on May 20, 2004 (gmt 0)

Either find (buy) a tool that can do it, or copy your robots.txt file to an http server to validate it. Most of these validators are syntax checkers only, so it won't matter that the pages the file refers to don't exist.

Usually, you can call the file anything you want and place it in any directory you like as well, because the validators expect you to validate a robots exclusion file before you actually name it robots.txt and put in on-line by doing so.

Jim

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved