Page is a not externally linkable
kevsh - 8:44 pm on May 17, 2005 (gmt 0)
I have a bunch of incoming links starting with "?" as in: www.mydomain.com/?=123 The query is handled by index.php. Problem is, Google seems to be seeing these as unique pages and not indexing any one of them (possible flagging as duplicate content?) In any event, I want to block all incoming links beginning with "?" AND any PHP page with a "?" appended, only. Examples of pages I WANT blocked: www.mydomain.com/?=123 Pages I DO NOT WANT blocked: www.mydomain.com/index.php I am thinking (hoping) this will work - at least for Google: User-Agent: googlebot If not, any suggestions on how to handle the above scenario?
Okay, this seems to be along the lines of my issue so I'll post here instead of a new thread.
www.mydomain.com/?=abc
www.mydomain.com/index.php?id=123
www.mydomain.com/dir/file.php?id=abc
www.mydomain.com/file.html
etc.
Disallow: /?
Disallow: /*.php?