Welcome to WebmasterWorld Guest from 54.158.240.147

Forum Moderators: goodroi

Message Too Old, No Replies

Altavista Scooter eats up too much trafic

     
5:28 am on Jan 24, 2004 (gmt 0)

New User

joined:Dec 28, 2002
posts:35
votes: 0


Hi
can somebody help me how to make a robots.txt so that Scooter visits my web site noy so often?
5:28 am on Jan 24, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 6, 2002
posts:742
votes: 0


You can disallow it, but I don't think you can slow it down. How fast is it getting your pages?