Forum Moderators: goodroi

Message Too Old, No Replies

simple robots.txt clarification

folders within folders

         

headown

5:49 pm on Jun 5, 2006 (gmt 0)

10+ Year Member



Within my robots.txt file I have for example:

Disallow: /gallery1/enlargehtml

I wish to disallow everything in the folder "enlargehtml" but allow all files in the folder "gallery1" to be spidered (except of course the folder "enlargehtml"). Is this the proper protocol?

Thanks,

Mike

Dijkgraaf

8:44 am on Jun 6, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Yes.

headown

9:04 am on Jun 6, 2006 (gmt 0)

10+ Year Member



Thanks! One more short question:

If I have:

Disallow: /homeHRD.htm

will this also disallow:

/homeHR.htm ?

Thanks in advance-

Dijkgraaf

10:02 am on Jun 6, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



No, it won't.

If you had
Disallow: /homeHR
it would disallow /homeHR.htm & /homeHRD.htm any anything else starting with /homeHR (files of any type & folders).
The disallow is saying, don't ask for anything begining with this.

SEO_junkie

8:55 pm on Jun 9, 2006 (gmt 0)

10+ Year Member



This site is great. Very helpful.

Thanks all