Welcome to WebmasterWorld Guest from 54.196.243.192

Forum Moderators: martinibuster

Message Too Old, No Replies

Yahoo Not Crawling My Site Like Google, MSN do

What types of issues will cause Yahoo's bot to have trouble?

     
8:09 pm on May 4, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:June 5, 2003
posts:121
votes: 0


Google has indexed 12,800 pages for my site.

MSN sees 5,258 pages.

Yahoo only has 902 pages.

The site has been around for years, though I switched domain names in Feb.

I'm wondering if the problem is my site is difficult in some way for Yahoo (and not the others) to crawl, or if Yahoo is just slower.

Feedback on your relevant personal experiences would be helpful.

Thanks,
Chris

4:38 am on May 5, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 1, 2005
posts:135
votes: 0


I have found Yahoo to be the slowest in crawling and updating and Google the quickest.
10:26 pm on May 19, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 8, 2004
posts:865
votes: 0


I put my site up at the beginning of april, so far,

Googlebot, 10 hits, 1 page indexed

MSN, nothing

Yahoo slurp, >2,000 hits and growing daily, 1 page indexed

10:37 pm on May 19, 2005 (gmt 0)

New User

10+ Year Member

joined:May 8, 2005
posts:29
votes: 0


Google is friggin wierd...

One of my sites I put up last _November_ and google only has the homepage indexed... a few more url only

Another site I put up a few weeks ago- google already has 4000 pages indexed...

MSN never leaves the site, and Yahoo is never seen.

The people getting a lot of hits from Yahoo... are you in the Yahoo directory / pay inclusion or did they just start slurping you?

11:30 pm on May 21, 2005 (gmt 0)

Junior Member

10+ Year Member

joined:May 23, 2003
posts:108
votes: 0


In my experience, Yahoo crawls and updates its index more slowly than Google. For example, Google indexes a new article from my site (PR=5) after one/three days. In the same period, Yahoo updates just the new home or subindex pages.
12:13 am on May 22, 2005 (gmt 0)

New User

10+ Year Member

joined:Apr 10, 2005
posts:14
votes: 0


I have a site that was indexed by Yahoo just 3-4 days after going live online (buying domain) and submiting for free to yahoo. I have submitted to google and googlebot came after 12 days. Yahoo bot comes every week. I have some News pages (they change everyday) - they get indexed by google once a week, yahoo slurp comes twice a day.
MSN is something in between for me (better than Google, worst than Yahoo Slurp).

I also have an older website, very well indexed by yahoo (and ok by msn) but google indexed only my first page and that's all....

2:31 am on May 23, 2005 (gmt 0)

Senior Member

joined:Dec 29, 2003
posts:5428
votes: 0


I have found Y! extremely fast in indexing new pages and content. Much faster than G or MSN...
2:41 am on May 23, 2005 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Jan 31, 2004
posts:710
votes: 0


This mostly depends on where you get your backlinks from. For example, if you get a link on a web site that is highly visited by Googlebot, Googlebot will likely visit your web site more often than from a link on a web site that isn't visited often. The same can be said about each search engine.