homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Yahoo / Yahoo Search Marketing Pay Per Click Advertising
Forum Library, Charter, Moderators: werty

Yahoo Search Marketing Pay Per Click Advertising Forum

Watch out for crawler.searchmarketing.yahoo.com
Badly behaving bot

 6:51 pm on Apr 1, 2006 (gmt 0)

Just a word of caution to anyone using Overture. Watch out for the bot, crawler.searchmarketing.yahoo.com (IP

This guy is currently behaving really badly, sending an exorbitant amount of simultaneous requests sustained over long periods of time. It brought our server down on its knees several times. Essentially it was acting as a Denial of Service attack.

We've had to temporarily ban the bot until Yahoo can tame this wild beast and make it be a bit more considerate [hey Yahoo, not everyone has a server farm you know].



 8:30 pm on Apr 1, 2006 (gmt 0)

I'm inclined to believe that this is a spoofed Y! bot.
The IP number does not belong to Y!


 8:47 pm on Apr 1, 2006 (gmt 0)

well then it's a damn good spoofer because it only hits sites which are running overture ads, and it only hits the ad urls. And increased # of ads coincides with increased activity from this bot. I am told it is their automated ad checker.


 8:58 pm on Apr 1, 2006 (gmt 0)

And also, searchmarketing.yahoo.com resolves to Yahoo is not listed as the owner of this IP either, but Savvis is, the same as the IP of crawler.searchmarketing.yahoo.com


 5:04 pm on Apr 4, 2006 (gmt 0)

It's the automated ad-checker ... but nobody at Y will acknowledge its existence. We have gone through a few extended battles with those bots over the past couple of years, and Y never admitted what was happening. The DoS aspect of the probing would certainly make for an interesting lawsuit ...

We started blocking the bots' IPs, and discovered that doing so kept us from receiving mail from SBC-Yahoo subscribers ... leading us to believe that not only are there unattended bots running from those servers, but that they are sharing the space with email users. When we unblock an IP based on an email message's headers so we can receive mail from that subscriber, the bots return.


 10:28 pm on Apr 13, 2006 (gmt 0)

I checked my logs and it is the only IP address that shows up in my reports for my yahoo ppc campaign. Should I report this to yahoo or is this a valid ip address?


 2:37 pm on Apr 14, 2006 (gmt 0)

I have seen this too. Every time we do a bulk upload, the bot brings our server down. Way to be professional, YSM!

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Yahoo Search Marketing Pay Per Click Advertising
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved