robots.txt

nervous beginner seeks reassurance

[jgar]

I have read some messages here about the robots.txt file, and understand it is vital to syntax it correctly.

Being a newcomer to the use of the robots.txt file, can someone please reassure me that the following is correct:

User-agent: *
Disallow: /Application/Pdcd/Langlab/Changelanggen.asp

The aim is to stop Googlebot trying to look at the page Changelanggen.asp, and the text file robots.txt is placed in the root directory.

Appreciate any comments.

[pageoneresults]

Hello jgar, you said...

Disallow: /Application/Pdcd/Langlab/Changelanggen.asp

Yes, that is correct. All other files within that directory will be indexed. Root directory is the only place you can put your robots.txt file.

[shelleycat]

I'm also new to using robots.txt and I found the validator provided by webmasterworld greatly helpful. Take a look here [searchengineworld.com...] :)

(darn typos)

[jgar]

Thanks for the tips - the validator is a great resource

[ciml]

Just one extra comment.

robots.txt is case sensitive, so "Disallow: /Application" disallows anything beginning with "/Application" but not "/application".

Has anyone checked that Google does this right?