Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Altavista Scooter eats up too much trafic

5:28 am on Jan 24, 2004 (gmt 0)

New User

joined:Dec 28, 2002
votes: 0

can somebody help me how to make a robots.txt so that Scooter visits my web site noy so often?
5:28 am on Jan 24, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 6, 2002
votes: 0

You can disallow it, but I don't think you can slow it down. How fast is it getting your pages?

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members