Yahoo Search Editorial Crashing Server

Yahoo Search, Editorial

[spintraffic]

Has anyone ever had this problem, I just bulk submitted 5,000 listings and within minutes all of our servers crashed.

I spoke with someone at Yahoo who confirmed that they do have a process that clicks on the links and it is possible that we'd get a lot of concurrent clicks.

We get a lot of traffic every day, so for Yahoo to take us down like this, they'd really have to hit us hard.

Has anyone had a similar experience, or at least can confirm a heavier server load right after a big bulk submission.

[StupidScript]

This is an issue that is well-known to any advertiser who has uploaded several thousand terms, and yet seems to be a mystery to Yahoo's 'support' people.

In the past, I've sent them dozens of megabytes of our log files showing slurp hammering our servers as it checks our submission. If you use the bulk upload to modify your listings, slurp will check both the old and the new versions ... sometime at rates up to 20 hits per second or more and often continuing for many, many hours (over 32, in one case).

Y 'support' has no idea what is going on. We end up blocking the bad (terribly rude) spider for a few days and it finally stops coming. Seems to have no impact on whether the listings are approved or not.

Good luck with that.

[ThreeMikes]

Actually, we have noticed this effect most definitely having an effect on the status of the listings, as we will end up with hundreds or thousands of declined listings with the reason being "broken site". Ironically, only appearing broken because YSM's own spiders brought the site to it's knees!

Mike