homepage Welcome to WebmasterWorld Guest from 54.227.171.163
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Validation Error
Ran the robots.txt validation checker and recieved nothing but errors.
jseamless

10+ Year Member



 
Msg#: 345 posted 12:09 pm on Mar 25, 2004 (gmt 0)

Any ideas why? I am using FrontPage. I really appreciate any feedback my site is <snip>

[edited by: oilman at 5:32 pm (utc) on Mar. 25, 2004]
[edit reason] no urls please [/edit]

 

King_de_SEO

10+ Year Member



 
Msg#: 345 posted 4:47 pm on Mar 25, 2004 (gmt 0)

I recently read an article snipped on robots.txt. They have provided a link to robots.txt validator. Well, I checked my robots.txt and faced something similar the first time I did.

I went back to the article:
snipped
and saw that I missed some instructions given along with the link-

"Please note that the full path to the robots.txt file must be entered in the field"

I was checking:
www.example.com
whereas I was supposed to check www.example.com/robots.txt

A very simple error which would put your home page to the test rather than the robots.txt file. Well, I guess that this could be a well expected error in usage on the user's part because they have put a small reminder right next to the url field:

"Enter the full url to the robots.txt file on your server" (http://www.searchengineworld.com/cgi-bin/robotcheck.cgi)

I hope that solves your problem.

[edited by: DaveAtIFG at 5:59 pm (utc) on Mar. 25, 2004]
[edit reason] Removed specifics [/edit]

jseamless

10+ Year Member



 
Msg#: 345 posted 5:06 pm on Mar 25, 2004 (gmt 0)

Thanks for the input. Fixed my problem!

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved