Forum Moderators: goodroi
This is the content of my robots.txt:
User-agent: *
Disallow: redirect.php
Disallow: /shared
What's wrong? I don't was any spinder to access the script redirect.php or any file in the folder /shared...
Thanks for you help!
/Niels
That should give you the answer.
Nobody but a robot should request a robots.txt file, so I do not see how such a file, however badly formed, could have any effect other than banning robots. Such an effect would not show on server traffic within ten minutes. There must be something else going on.
Did you modify the .htaccess file at the same time by any chance?