|Yahoo Not Crawling My Site Like Google, MSN do|
What types of issues will cause Yahoo's bot to have trouble?
Google has indexed 12,800 pages for my site.
MSN sees 5,258 pages.
Yahoo only has 902 pages.
The site has been around for years, though I switched domain names in Feb.
I'm wondering if the problem is my site is difficult in some way for Yahoo (and not the others) to crawl, or if Yahoo is just slower.
Feedback on your relevant personal experiences would be helpful.
I have found Yahoo to be the slowest in crawling and updating and Google the quickest.
I put my site up at the beginning of april, so far,
Googlebot, 10 hits, 1 page indexed
Yahoo slurp, >2,000 hits and growing daily, 1 page indexed
Google is friggin wierd...
One of my sites I put up last _November_ and google only has the homepage indexed... a few more url only
Another site I put up a few weeks ago- google already has 4000 pages indexed...
MSN never leaves the site, and Yahoo is never seen.
The people getting a lot of hits from Yahoo... are you in the Yahoo directory / pay inclusion or did they just start slurping you?
In my experience, Yahoo crawls and updates its index more slowly than Google. For example, Google indexes a new article from my site (PR=5) after one/three days. In the same period, Yahoo updates just the new home or subindex pages.
I have a site that was indexed by Yahoo just 3-4 days after going live online (buying domain) and submiting for free to yahoo. I have submitted to google and googlebot came after 12 days. Yahoo bot comes every week. I have some News pages (they change everyday) - they get indexed by google once a week, yahoo slurp comes twice a day.
MSN is something in between for me (better than Google, worst than Yahoo Slurp).
I also have an older website, very well indexed by yahoo (and ok by msn) but google indexed only my first page and that's all....
I have found Y! extremely fast in indexing new pages and content. Much faster than G or MSN...
This mostly depends on where you get your backlinks from. For example, if you get a link on a web site that is highly visited by Googlebot, Googlebot will likely visit your web site more often than from a link on a web site that isn't visited often. The same can be said about each search engine.