| Welcome to WebmasterWorld Guest from 126.96.36.199 |
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
|Subscribe to WebmasterWorld|
| Forum Library : Charter : Moderators: werty |
Yahoo Search Marketing Pay Per Click Advertising Forum
|Yahoo Product Submit Crawlers Not Behaving?|
| 11:40 am on May 6, 2008 (gmt 0)|
Anyone out there use Yahoo Product Submit notice that the spiders have two main issues:
(1) The spiders don't seem to be properly identifying themselves
(2) The spiders often crawl a single site at a rate of 20 pages per second (which is incredibly high crawl rate).
Anyone else notice that?
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
© Webmaster World 1996-2013 all rights reserved