Forum Moderators: open

Message Too Old, No Replies

Google Robots txt Question

         

mikemcs

2:16 pm on Jan 5, 2004 (gmt 0)

10+ Year Member



Am correct in thinking that this:
User-agent: googlebot
Disallow: /PFCatalog.php

will prevent google from indexing this url:
www.MySite.com/CCS/PFCatalog.php?Cat=71

It seems to not have worked. This is a new page and I added it the same day I added the robots.txt but it seems as if it is not working because google bot is in my logs on that page.

Oaf357

4:46 pm on Jan 5, 2004 (gmt 0)

10+ Year Member



You should use "CCS/PFCatalog.php" without the quotes.

That should get it blocked.

GodLikeLotus

4:48 pm on Jan 5, 2004 (gmt 0)

10+ Year Member



This question should be in robots.txt forum,
[webmasterworld.com...]

Brett, I'm not looking for a job but I thought that all New threads in Google News Forum were being checked first.