Welcome to WebmasterWorld Guest from 23.20.241.155

Forum Moderators: open

Message Too Old, No Replies

deny Scooter IP.

     
1:50 pm on Apr 2, 2003 (gmt 0)

10+ Year Member



Hi there, I try to stop Scooter request from IP 216.39.48.X
Whit no results :(
I have put robots.txt file in /root/ of the server and also in local for each domain server :

User-agent: Scooter
Disallow: /

May be I have done something wrong? Please help is welcome

2:02 pm on Apr 2, 2003 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



bignooz,

Put your robots.txt in the root directory of each site - in the same directory as your main "index.html" page. Robots will look for it there, and nowhere else. Then, validate your robots.txt files here [searchengineworld.com].

HTH,
Jim

2:19 pm on Apr 2, 2003 (gmt 0)

10+ Year Member



Thank you Jim!
One thing, put the robots.txt in each domain root is not effective as i am using .htaccess file with "rewrite" index.php orders.
Put the robots.txt file just in the serverīs root can help?
2:40 pm on Apr 2, 2003 (gmt 0)

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member



No, It must be (or appear to be, by using an internal redirect rewrite) at [yourdomain.com...]

Jim

 

Featured Threads

Hot Threads This Week

Hot Threads This Month