Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Altavista Scooter eats up too much trafic



5:28 am on Jan 24, 2004 (gmt 0)

can somebody help me how to make a robots.txt so that Scooter visits my web site noy so often?


5:28 am on Jan 24, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

You can disallow it, but I don't think you can slow it down. How fast is it getting your pages?

Featured Threads

Hot Threads This Week

Hot Threads This Month