Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Altavista Scooter eats up too much trafic

5:28 am on Jan 24, 2004 (gmt 0)

New User

joined:Dec 28, 2002
votes: 0

can somebody help me how to make a robots.txt so that Scooter visits my web site noy so often?
5:28 am on Jan 24, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 6, 2002
votes: 0

You can disallow it, but I don't think you can slow it down. How fast is it getting your pages?