| deny Scooter IP.
|
bignooz
msg:16611 | 1:50 pm on Apr 2, 2003 (gmt 0) |
Hi there, I try to stop Scooter request from IP 216.39.48.X
Whit no results :(
I have put robots.txt file in /root/ of the server and also in local for each domain server : User-agent: Scooter
Disallow: / May be I have done something wrong? Please help is welcome
|
jdMorgan
msg:16612 | 2:02 pm on Apr 2, 2003 (gmt 0) |
bignooz, Put your robots.txt in the root directory of each site - in the same directory as your main "index.html" page. Robots will look for it there, and nowhere else. Then, validate your robots.txt files here [searchengineworld.com]. HTH,
Jim
|
bignooz
msg:16613 | 2:19 pm on Apr 2, 2003 (gmt 0) |
Thank you Jim!
One thing, put the robots.txt in each domain root is not effective as i am using .htaccess file with "rewrite" index.php orders.
Put the robots.txt file just in the serverīs root can help?
|
jdMorgan
msg:16614 | 2:40 pm on Apr 2, 2003 (gmt 0) |
No, It must be (or appear to be, by using an internal redirect rewrite) at [yourdomain.com...] Jim
|
|
|
