Welcome to WebmasterWorld Guest from 54.196.224.166

Forum Moderators: mack

Message Too Old, No Replies

MSN bot wont crawl any of my sites?

Google and Yahoo crawl fine

     

mancunian

7:03 pm on Sep 29, 2008 (gmt 0)

10+ Year Member



The only pages MSN crawls are the ones I submit using the Live search url submission page.

It never follows the links to other pages on any of my sites. How do I get it to crawl and index the whole site.

Google and MSN crawl all my sites fine? The sites have sitemaps and there is nothing blocking in robots.

Any ideas?

anallawalla

2:56 am on Oct 24, 2008 (gmt 0)

WebmasterWorld Administrator anallawalla is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I am watching about 20 international sites each with millions of pages in Google. Live seems to index about 1% or less. Don't know why. Yahoo indexing can be better than G or worse than G, or pretty much the same i.e. normal variations.

mancunian

8:25 am on Oct 24, 2008 (gmt 0)

10+ Year Member



Thank you for the reply.

Google and Yahoo crawl fine but MSN crawls one page unless I submit each page manually which is not practical on large sites.

mancunian

8:25 am on Oct 24, 2008 (gmt 0)

10+ Year Member



Thank you for the reply.

Google and Yahoo crawl fine but MSN crawls one page unless I submit each page manually which is not practical on large sites.