effisk - 10:20 am on Nov 30, 2005 (gmt 0) Lemme see... you can create robots.txt.php... [edited by: trillianjedi at 12:26 pm (utc) on Nov. 30, 2005]
by the way, how do you cloak a .txt file? I remember trying that with .css but I couldn't figure it out, didn't spend very long on it though, that's in an apache php environment, is it just a htaccess thing? Anybody feel like sharing the code?
<?php header('Content-Type: text/plain;');
echo "User-agent: *\n";
echo "Disallow: /*";
then I don't remember well what to put in the .htaccess file... maybe something like
not sure. I've done that for a specific problem when I had to redirect from an old url to a new one while my pages where still the same (same server, etc.)
[edit reason] Examplifying [/edit]
Lemme see... you can create robots.txt.php...
[edited by: trillianjedi at 12:26 pm (utc) on Nov. 30, 2005]