Welcome to WebmasterWorld Guest from

Forum Moderators: werty

Message Too Old, No Replies

Yahoo Search Editorial Crashing Server

Yahoo Search, Editorial

10:24 pm on May 24, 2006 (gmt 0)

New User

10+ Year Member

joined:Sept 29, 2004
votes: 0

Has anyone ever had this problem, I just bulk submitted 5,000 listings and within minutes all of our servers crashed.

I spoke with someone at Yahoo who confirmed that they do have a process that clicks on the links and it is possible that we'd get a lot of concurrent clicks.

We get a lot of traffic every day, so for Yahoo to take us down like this, they'd really have to hit us hard.

Has anyone had a similar experience, or at least can confirm a heavier server load right after a big bulk submission.

5:26 pm on May 25, 2006 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Apr 20, 2004
votes: 0

This is an issue that is well-known to any advertiser who has uploaded several thousand terms, and yet seems to be a mystery to Yahoo's 'support' people.

In the past, I've sent them dozens of megabytes of our log files showing slurp hammering our servers as it checks our submission. If you use the bulk upload to modify your listings, slurp will check both the old and the new versions ... sometime at rates up to 20 hits per second or more and often continuing for many, many hours (over 32, in one case).

Y 'support' has no idea what is going on. We end up blocking the bad (terribly rude) spider for a few days and it finally stops coming. Seems to have no impact on whether the listings are approved or not.

Good luck with that.

6:34 pm on May 25, 2006 (gmt 0)

New User

10+ Year Member

joined:Apr 19, 2006
votes: 0

Actually, we have noticed this effect most definitely having an effect on the status of the listings, as we will end up with hundreds or thousands of declined listings with the reason being "broken site". Ironically, only appearing broken because YSM's own spiders brought the site to it's knees!



Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members