homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Marketing and Biz Dev / General Search Engine Marketing Issues
Forum Library, Charter, Moderators: mademetop

General Search Engine Marketing Issues Forum

Yahoo vs MSN vs Google

 2:54 pm on Aug 27, 2004 (gmt 0)

I get deep crawled by Yahoo and MSN a lot, but Google only hits the homepage and then takes off. What gives? Why is Google, which is supposedly the king of all search engines, not updating their results? My new pages have already hit both Yahoo and MSN, so they would appear to actually be better search engines because they provide more up-to-date info.



 5:29 pm on Aug 27, 2004 (gmt 0)

yahoo and msn are currently the same. msnbot is for a future search engine they are developing. google can take some time. how long has your site been up? if just a few weeks, this is entirely normal. build links to your site and you will see improved results.


 3:20 pm on Aug 28, 2004 (gmt 0)

My site has been online since July, so you would think that Google could have taken the time to deep crawl it by now.


 3:36 pm on Aug 28, 2004 (gmt 0)

How many links from other sites do you have?
Might Google have looked at it and disliked it for
1) hidden text.
2) duplicate content.
3) excessive crosslinking with other sites
4) queer linking (using urls that might look like session IDs)


If none of the above or other faux pas apply, Google will get around to you if the backlinks are there (unless something else silly is going on like your host banning googlebot).

Also, you may need backlinks to critical pages, not just your home page.



 4:00 pm on Aug 28, 2004 (gmt 0)

I haven't done anything underhanded. I have never believed in tricking the search engines. It's all on the up and up for me.

I have been building back links and I would say that I have about 20 or 30 by now.

Why would a hosting provider want to ban Googlebot? And, if it was banned, I would think that it wouldn't even be hitting the homepage at all.


 8:47 pm on Aug 28, 2004 (gmt 0)

it may just be a matter of time. it can take weeks and weeks to get deep crawled. build more backlinks.

also, you link to other sites and it appears from my quick look that most are high quality retail outlets. make sure it stays that way. don't link to potentially sleazy merchants who are likely to use shady seo practices that get them put in what google calls "bad neighborhoods".


 9:18 pm on Aug 28, 2004 (gmt 0)

I have never heard the term "bad neighborhoods" before. Could you please elaborate? Thanks!


 9:42 pm on Aug 28, 2004 (gmt 0)

As far as I know, Google doesn't precisely define them.

The basic idea is to avoid linking to sites which are pure link farms, or sites that are designed entirely for search engines and have no functional purpose for a user.

One safe bet is to avoid sites with 0 PageRank. With that said, some 0 PR sites are simply that because they are new. A more inclusive policy is simply link to sites that appear to be serious efforts at providing a useful service for users - whether it is information or shopping.

You seem to be doing quite fine from what I saw - the links were to established companies that spent a lot of money on providing shoppers with a useful service, whether online or in their brick and mortar establishments.


 10:21 pm on Aug 28, 2004 (gmt 0)

You can see how the search engines are related. [bruceclay.com]

Google isn't real specific about definitions, but these two descriptions are official:

No link exchange or "free-for-all" link program. [google.com]

Avoid Bad Neighborhoods [searchvisibilityreport.com]



 11:01 pm on Aug 28, 2004 (gmt 0)

Wallace, also make sure your robots.txt file isn't blocking G-bot's access to all files but your homepage. Allow two months for Google to actually include you in it's serps. You should be able to get your entire site into the index within 3-4 weeks of going live (even though those pages won't show in the serps). While you're waiting, work on getting links from other sites and directories to your site.


 11:46 pm on Aug 28, 2004 (gmt 0)

Just a matter of time. I had a new site up with a couple links and got deepcrawled in a week. I'd suggest go on your business of building content and getting links and it will happen.

As for Google being the king of all searches, don't make me laugh. In terms of popularity, yes, in terms of quality, they have a dunce hat on.


 12:48 am on Aug 29, 2004 (gmt 0)

In terms of popularity, yes, in terms of quality, they have a dunce hat on.

Unless people believe the latter, the former is all that really matters. People's perception is thier reality, that's the important point to understand.

For an example of a higher quality product that died think betamax.


 2:16 am on Aug 29, 2004 (gmt 0)

Okay, I'll bite. If google is only tops in popularity, then who is king of quality?

You know what site that I used to really love, but it went down the tubes? Ask Jeeves. Great idea. I could find what I was looking for just about every time.

It all went down hill when their results became littered with paid placements. I mean I realize a person has to make a buck, but not at the expense of the overall quality of your site.


 3:23 am on Aug 29, 2004 (gmt 0)

I agree, I loved Ask Jeeves/Teoma. In fact, I still kind of do. I think over the past couple years everyone has been optimizing for Google and MSN and Yahoo have been able to put together some pretty nice results in some industries. I guess I do most of my searching for things I need like finding a dentist or doing research on something. Google is pretty worthless in those regards.


 6:15 am on Aug 29, 2004 (gmt 0)

Hurrah. No sooner was I saying that Google wasn't deep crawling my site when what should happen? You guessed it. Googlebot just showed up and is going to town on my site. It's going here, there, and everywhere. Yippee for me. :-)


 12:12 pm on Aug 30, 2004 (gmt 0)

I'm seeing a steady increase in yahoo traffic especially over the past 6 weeks with the same ranks. Maybe yahoo is gaining in popularity/use?


 12:15 pm on Aug 30, 2004 (gmt 0)

One thing I've never understood with google is why do they miss so many backlinks? They miss obvious ones like dmoz, with the site having been there for over a year. Most of the other se's show all sites that link to a site. Google seems to just show about 20% or so.


 12:40 pm on Aug 30, 2004 (gmt 0)

Hey siteseo,

Wallace, also make sure your robots.txt file isn't blocking G-bot's access to all files but your homepage.

Are you saying you SHOULD block the homepage?


 12:52 pm on Aug 30, 2004 (gmt 0)

My site gets crawled all the time all year around, from Yahoo, MSN and google, but I can see that MSN gives me more and more visitors everyday, Yahoo and Google goes down a little everyday, my rankings have not change there.


 4:15 am on Aug 31, 2004 (gmt 0)

My site is still ranking well in Google, but haven't seen a deep crawl in at least three months. Google will at best get 200 pages of a 15,000 page site, then leave. MSN and Yahoo don't get many pages at a time, but they are consistantly hitting the site.

Google previously deep crawled at least once a month and sometime more often. Has anyone else noticed decreased activity? Do I need to be concerned?


 8:32 am on Aug 31, 2004 (gmt 0)

Dear friends,

I too face something in this way. Many of client site has been crawled by Yahoo MSN and is ranking but not in Google.

Its almost more than 2 months passed, site is not been updated in Google. And some sites are updated but there is no differnce in SERPS.

JK Appu

Global Options:
 top home search open messages active posts  

Home / Forums Index / Marketing and Biz Dev / General Search Engine Marketing Issues
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved