Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: mack
I've just been hit for 700MB in 4 days, and would like to know what to expect from now on.
I know others have been hit even harder - Surely the default crawl rate should be stepped down a bit without special instructions? It's not the only spider around, after all!