homepage Welcome to WebmasterWorld Guest from 54.226.93.128
register, free tools, login, search, subscribe, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Visit PubCon.com
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

    
Yahoo Excessive Crawling.
crawling 500+ pages over and over again yet NO visitors
rajannewton




msg:4173263
 12:01 pm on Jul 20, 2010 (gmt 0)

A while ago I noticed that on one of my sites, crawling 500+ pages over and over again yet NO visitors. i cheked and its yahoo crawler so I blocked Y from crawling, they're wasting my bandwidth. Each month 35% of all bandwidth is used by Yahoo Slurp. Pl. suggest what we do to slow a yahoo crawler.

 

pathmaker




msg:4174459
 3:30 am on Jul 22, 2010 (gmt 0)

I experience that same thing too. please do suggest ways to slow down yahoo crawler.

zeus




msg:4179948
 10:39 pm on Jul 31, 2010 (gmt 0)

yep same here was like ddos attack server went totally slow

skweb




msg:4180624
 3:15 pm on Aug 2, 2010 (gmt 0)

Ranking and crawling are two entirely different things. Unfortunately if you want to be found you have to pay for bandwidth. So blocking a search engine is not the answer. The key is to build links so that you can also raise your website's rankings.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved