Welcome to WebmasterWorld Guest from

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Not Crawling My Site Like Google, MSN do

What types of issues will cause Yahoo's bot to have trouble?



8:09 pm on May 4, 2005 (gmt 0)

10+ Year Member

Google has indexed 12,800 pages for my site.

MSN sees 5,258 pages.

Yahoo only has 902 pages.

The site has been around for years, though I switched domain names in Feb.

I'm wondering if the problem is my site is difficult in some way for Yahoo (and not the others) to crawl, or if Yahoo is just slower.

Feedback on your relevant personal experiences would be helpful.



4:38 am on May 5, 2005 (gmt 0)

10+ Year Member

I have found Yahoo to be the slowest in crawling and updating and Google the quickest.


10:26 pm on May 19, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

I put my site up at the beginning of april, so far,

Googlebot, 10 hits, 1 page indexed

MSN, nothing

Yahoo slurp, >2,000 hits and growing daily, 1 page indexed


10:37 pm on May 19, 2005 (gmt 0)

10+ Year Member

Google is friggin wierd...

One of my sites I put up last _November_ and google only has the homepage indexed... a few more url only

Another site I put up a few weeks ago- google already has 4000 pages indexed...

MSN never leaves the site, and Yahoo is never seen.

The people getting a lot of hits from Yahoo... are you in the Yahoo directory / pay inclusion or did they just start slurping you?


11:30 pm on May 21, 2005 (gmt 0)

10+ Year Member

In my experience, Yahoo crawls and updates its index more slowly than Google. For example, Google indexes a new article from my site (PR=5) after one/three days. In the same period, Yahoo updates just the new home or subindex pages.


12:13 am on May 22, 2005 (gmt 0)

10+ Year Member

I have a site that was indexed by Yahoo just 3-4 days after going live online (buying domain) and submiting for free to yahoo. I have submitted to google and googlebot came after 12 days. Yahoo bot comes every week. I have some News pages (they change everyday) - they get indexed by google once a week, yahoo slurp comes twice a day.
MSN is something in between for me (better than Google, worst than Yahoo Slurp).

I also have an older website, very well indexed by yahoo (and ok by msn) but google indexed only my first page and that's all....


2:31 am on May 23, 2005 (gmt 0)

I have found Y! extremely fast in indexing new pages and content. Much faster than G or MSN...


2:41 am on May 23, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member

This mostly depends on where you get your backlinks from. For example, if you get a link on a web site that is highly visited by Googlebot, Googlebot will likely visit your web site more often than from a link on a web site that isn't visited often. The same can be said about each search engine.

Featured Threads

Hot Threads This Week

Hot Threads This Month