Welcome to WebmasterWorld Guest from 54.158.175.78

Forum Moderators: mack

Message Too Old, No Replies

Very few hits from MSNBOT (and yahoo too)

   
6:32 pm on Feb 4, 2009 (gmt 0)

5+ Year Member



The crawler activity on my site is rather strange. The site is very well indexed in Google and performs pretty strong in the SERPS. But Microsoft Search and Yahoo do not even index the site correctly. The site is live since September 2008.

Here's the Spider activity for the last 4 days:

Googlebot - 46534+43 - 53.86 MB - 04 Feb 2009 - 19:00
Google AdSense - 2365 - 15.09 MB - 04 Feb 2009 - 18:57
MJ12bot - 1769+6 - 12.62 MB - 02 Feb 2009 - 21:42
Yahoo Slurp - 553+18 - 13.28 MB - 04 Feb 2009 - 18:11
Unknown robot (identified by 'bot/' or 'bot-') - 144+59 - 1.22 MB - 03 Feb 2009 - 18:37
Feedburner - 94 - 262.96 KB - 04 Feb 2009 - 18:48
MSNBot - 21+15 - 59.98 KB - 04 Feb 2009 - 00:24

Any suggestions what I can do to stimulate the other search engines?

[edited by: eRAZOR at 6:35 pm (utc) on Feb. 4, 2009]

5:06 pm on Feb 7, 2009 (gmt 0)

WebmasterWorld Administrator incredibill is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



Does your site have constantly changing content?

If not, some bots will slow down and crawl less frequently as static content doesn't require rapid reindexing.