joined:Apr 20, 2004
If my server defaults to process index.php first and I state in a robots.txt file to not process index.php but allow index.html and all pages linked to it, would this be a good (enough) strategy for allowing regular visitors to run the frames based website at index.php and force all SE to see only the index.html website? You know what I mean. Thanks for all your input. I suspect that's better than using the NOFRAMES tag in index.php, eh?
Also, do I have to explicately state in robots.txt not to go to each of the .php files or will the fact that they are never linked to from index.html cover me?