Welcome to WebmasterWorld Guest from 54.146.201.80

Forum Moderators: open

Message Too Old, No Replies

deny Scooter IP.

     
1:50 pm on Apr 2, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 9, 2003
posts:24
votes: 0


Hi there, I try to stop Scooter request from IP 216.39.48.X
Whit no results :(
I have put robots.txt file in /root/ of the server and also in local for each domain server :

User-agent: Scooter
Disallow: /

May be I have done something wrong? Please help is welcome

2:02 pm on Apr 2, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


bignooz,

Put your robots.txt in the root directory of each site - in the same directory as your main "index.html" page. Robots will look for it there, and nowhere else. Then, validate your robots.txt files here [searchengineworld.com].

HTH,
Jim

2:19 pm on Apr 2, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 9, 2003
posts:24
votes: 0


Thank you Jim!
One thing, put the robots.txt in each domain root is not effective as i am using .htaccess file with "rewrite" index.php orders.
Put the robots.txt file just in the serverīs root can help?
2:40 pm on Apr 2, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member jdmorgan is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Mar 31, 2002
posts:25430
votes: 0


No, It must be (or appear to be, by using an internal redirect rewrite) at [yourdomain.com...]

Jim

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members