Is there a way in robot.txt I can configure the search engines not to index any PHP files?
Little_G
9:36 pm on Apr 21, 2006 (gmt 0)
Hi,
No, try robots meta tags.
Andrew
Dijkgraaf
4:17 am on Apr 22, 2006 (gmt 0)
You would either have to put all of those pages in a directory that you disallow, or have a naming convention so that they all start with a certain string that you could disallow.
Only a few search engines allow you to use file extension wildcards, so the above options would be much safer.