Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: werty
I spoke with someone at Yahoo who confirmed that they do have a process that clicks on the links and it is possible that we'd get a lot of concurrent clicks.
We get a lot of traffic every day, so for Yahoo to take us down like this, they'd really have to hit us hard.
Has anyone had a similar experience, or at least can confirm a heavier server load right after a big bulk submission.
In the past, I've sent them dozens of megabytes of our log files showing slurp hammering our servers as it checks our submission. If you use the bulk upload to modify your listings, slurp will check both the old and the new versions ... sometime at rates up to 20 hits per second or more and often continuing for many, many hours (over 32, in one case).
Y 'support' has no idea what is going on. We end up blocking the bad (terribly rude) spider for a few days and it finally stops coming. Seems to have no impact on whether the listings are approved or not.
Good luck with that.