If I disallow /filename.php ...

will google still index /filename.php?whatever

[Trisha]

If I disallow /filename.php will google still index /filename.php?whatever

Sorry if this has been discussed here already. It seems like I remember hearing once that they might. I was thinking that if this is true I should put that file in a separate directory like 'widget' and then just 'disallow /widget' and then that would keep google from indexing any possible '/widget/filename.php?whatever'.

[ThomasB]

Trisha, Google won't index the page with the? in the url.

[Lord Majestic]

Google won't index the page with the? in the url.

Is that supposed to mean that Google won't index dynamic pages or only those pages that have no proper query parameters?

[Trisha]

Thanks Thomas! That makes things a lot easier!

[ThomasB]

LM, here's what I was referring to:

robots.txt

user-agent: *
Disallow: /filename.php

Google won't index /filename.php?whatever

[Trisha]

Thomas - when I type in the site: command, pages are listed that are like this:

www.mydomain.com/ifw_nm.php?rurl=578237

even though I disallowed ifw_nm.php in my robots file. Are those pages supposed to show up when doing the site: command?

[jdMorgan]

robots.txt stops the pages from being fetched. It does not stop the URLs from being listed if they are found elsewhere (e.g. links found on other sites).

If this applies to any one of your pages, you'll find that it is listed without a normal title or description. If there is a title or description, you'll find that the information has been derived from the links to that page, not from the content of that page.

See message #3 (and later) of this old thread [webmasterworld.com] for more details.

Jim