homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
Forum Library, Charter, Moderators: martinibuster

Yahoo Search Engine and Directory Forum

Yahoo Not Crawling My Site Like Google, MSN do
What types of issues will cause Yahoo's bot to have trouble?

 8:09 pm on May 4, 2005 (gmt 0)

Google has indexed 12,800 pages for my site.

MSN sees 5,258 pages.

Yahoo only has 902 pages.

The site has been around for years, though I switched domain names in Feb.

I'm wondering if the problem is my site is difficult in some way for Yahoo (and not the others) to crawl, or if Yahoo is just slower.

Feedback on your relevant personal experiences would be helpful.




 4:38 am on May 5, 2005 (gmt 0)

I have found Yahoo to be the slowest in crawling and updating and Google the quickest.


 10:26 pm on May 19, 2005 (gmt 0)

I put my site up at the beginning of april, so far,

Googlebot, 10 hits, 1 page indexed

MSN, nothing

Yahoo slurp, >2,000 hits and growing daily, 1 page indexed


 10:37 pm on May 19, 2005 (gmt 0)

Google is friggin wierd...

One of my sites I put up last _November_ and google only has the homepage indexed... a few more url only

Another site I put up a few weeks ago- google already has 4000 pages indexed...

MSN never leaves the site, and Yahoo is never seen.

The people getting a lot of hits from Yahoo... are you in the Yahoo directory / pay inclusion or did they just start slurping you?


 11:30 pm on May 21, 2005 (gmt 0)

In my experience, Yahoo crawls and updates its index more slowly than Google. For example, Google indexes a new article from my site (PR=5) after one/three days. In the same period, Yahoo updates just the new home or subindex pages.


 12:13 am on May 22, 2005 (gmt 0)

I have a site that was indexed by Yahoo just 3-4 days after going live online (buying domain) and submiting for free to yahoo. I have submitted to google and googlebot came after 12 days. Yahoo bot comes every week. I have some News pages (they change everyday) - they get indexed by google once a week, yahoo slurp comes twice a day.
MSN is something in between for me (better than Google, worst than Yahoo Slurp).

I also have an older website, very well indexed by yahoo (and ok by msn) but google indexed only my first page and that's all....


 2:31 am on May 23, 2005 (gmt 0)

I have found Y! extremely fast in indexing new pages and content. Much faster than G or MSN...


 2:41 am on May 23, 2005 (gmt 0)

This mostly depends on where you get your backlinks from. For example, if you get a link on a web site that is highly visited by Googlebot, Googlebot will likely visit your web site more often than from a link on a web site that isn't visited often. The same can be said about each search engine.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Yahoo / Yahoo Search Engine and Directory
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved