homepage Welcome to WebmasterWorld Guest from 107.22.138.215
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
Forum Library, Charter, Moderators: Brett Tabke

Paid Inclusion Engines and Topics Forum

  posting off  
altavista scooter taking too many pages
scooter is sucking down 4 pages per second
cyberprosper




msg:24031
 10:23 pm on Oct 2, 2003 (gmt 0)

As anybody else had this problem with scooter? Their web robot crashed my server.. they have been sucking down more than 4 pages per second!

I can't even find the proper place to contact them about this. In the meanwhile, they have been blocked with a 403 error.

 

requiem




msg:24032
 12:07 am on Oct 3, 2003 (gmt 0)

This is normal :-) Wait it out or block scooter with robots.txt

BlueSky




msg:24033
 12:39 am on Oct 3, 2003 (gmt 0)

Oh really. When Scooter visits me, he goes in really slow motion like one page every 10 minutes or so. He's the only one which does that.

gibEll




msg:24034
 12:04 am on Oct 9, 2003 (gmt 0)

He's eating too quickly on my site too, not to mention grabbing malformed file names. They need to fix it and fast.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Advertising / Paid Inclusion Engines and Topics
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved