Does excluding a cgi page automatically disable same page with paramet
paramters?
Clark
7:18 pm on Sep 10, 2005 (gmt 0)
If I disable search.php will that automatically disable search.php?query=1 search.php?query=2 search.php?query=3 search.php?query=4&query=6 search.php?query=5
Lord Majestic
12:10 am on Sep 11, 2005 (gmt 0)
Yes, say if you delete search.php then all URLs that have it as filename will fail regardless of params.
Note that this is not really the right forum for this sort of question.
Clark
2:35 am on Sep 11, 2005 (gmt 0)
I probably worded it poorly. I mean if I disallow search.php in robots.txt will the search engines not crawl search.php?query=1 I have the feeling you thought I meant something else.
Lord Majestic
3:47 am on Sep 11, 2005 (gmt 0)
I mean if I disallow search.php in robots.txt will the search engines not crawl search.php?query=1
Yes, so long as you make sure correct patch is used -- according to robots.txt standard a URL will be considered disallowed if it starts with whatever was in disallowed field.