Forum Moderators: mack

Message Too Old, No Replies

How do you get deep content in the Index?

MSN tends to top skim but i need a deep crawl

         

RichTC

12:19 am on Jun 2, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi all,

Love MSN, its a great search engine and cant complain.

We get some great positions in MSN search for our major keywords (dont see much traffic mind you) but have very little in the index for deeper content.

Its almost like it top skims your site for content and related content one deep and likes to index that especially if its always up to date. Almost all of the positions we have in the index are taken from one deep.

However, going two/three deep it takes very little content.

Anyone have any tips how i could encourage MSN to deep index more of the site content?. I dont have this issue with Google or Yahoo - external links tend to take these bots in and they index outwards from that point.

Anyone else had a similar experience? or have any ideas to assist

Thanks in advance

diamondgrl

4:45 pm on Jun 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



They only skim the surface here too. It seems they (and Yahoo) really need to work on this.

I picked an authority newspaper site as a test:

On Google, site:www.latimes.com gives 401000 pages.

On MSN, only 7734 pages.

The ratio on my large authority site is a lot lower.

Staffa

5:54 pm on Jun 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just the opposite here. Six weeks ago I launched a new site (dynamic) and MSN has crawled - two and three deep - about half of the site (approx 300 pages) and the search results are very pleasing.

On the other hand, Y and G are still at the index and one level deep.

Go figure ;o)

steveb

8:14 pm on Jun 3, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



At this point I don't think there is anything to do. MSN as policy skims the surface. It's one of the horrible conceptual choices they have made. Until they decide to have a real search engine, a webmaster can't force them.

Shurik

9:00 pm on Jun 3, 2005 (gmt 0)

10+ Year Member



I released a new site about 3 weeks ago.
It has 52 pages in total.
Google - 3 levels deep, all pages indexed
MSN - 3 levels deep, all pages indexed
Yahoo - home page only

I hate to admit it but google was the first one to index the entire site. I was hoping that MSN would beat them to it.

dicks

3:41 am on Jun 7, 2005 (gmt 0)

10+ Year Member



Google shows 12,900 pages for our site and MSN only shows 111 pages. Our site only goes four levels, any ideas on how to get MSN to search more pages? MSN has some pages from all levels.

zeus

11:41 am on Jun 7, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Remember to go a few pages, for the real count of pages indexed, ths count on the first page of a site:yoursite.com is always a fake.

About google they also dont count for real anymore.