Welcome to WebmasterWorld Guest from 54.211.136.250

Forum Moderators: mack

Message Too Old, No Replies

MSN bot wont crawl any of my sites?

Google and Yahoo crawl fine

   
7:03 pm on Sep 29, 2008 (gmt 0)

10+ Year Member



The only pages MSN crawls are the ones I submit using the Live search url submission page.

It never follows the links to other pages on any of my sites. How do I get it to crawl and index the whole site.

Google and MSN crawl all my sites fine? The sites have sitemaps and there is nothing blocking in robots.

Any ideas?

2:56 am on Oct 24, 2008 (gmt 0)

WebmasterWorld Administrator anallawalla is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I am watching about 20 international sites each with millions of pages in Google. Live seems to index about 1% or less. Don't know why. Yahoo indexing can be better than G or worse than G, or pretty much the same i.e. normal variations.
8:25 am on Oct 24, 2008 (gmt 0)

10+ Year Member



Thank you for the reply.

Google and Yahoo crawl fine but MSN crawls one page unless I submit each page manually which is not practical on large sites.

8:25 am on Oct 24, 2008 (gmt 0)

10+ Year Member



Thank you for the reply.

Google and Yahoo crawl fine but MSN crawls one page unless I submit each page manually which is not practical on large sites.