Welcome to WebmasterWorld Guest from 54.167.46.29

Forum Moderators: mack

Message Too Old, No Replies

Why do I see so many MSNBot Spiders?

     
1:54 pm on Oct 21, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Feb 24, 2008
posts: 93
votes: 0


My 2 year old site used to get between 300 to 600 pages viewed by MSNBot Spiders daily. However, starting September 17th the number of page views by MSNBot Spiders jumped to between 2,500 and 3,000. It has been at this high level ever since (about 5 weeks now).

I never received much traffic from Microsoft's search engines, and it still is just a small percentage of my over all traffic.

Is there any explanation for this unusually high MSNBot Spider traffic?

10:44 pm on Oct 21, 2009 (gmt 0)

Junior Member

5+ Year Member

joined:Feb 24, 2008
posts: 93
votes: 0


... and why am I asking the above question? Well, this very minute I have 83 visitors on my site:

* 37 people
* 1 Yahoo! Slurp Spider
* 1 Google Spider
* 1 AskJeeves Spider
* 43 MSNBot Spiders

Why so many MSNBot Spiders?

9:13 pm on Oct 22, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member billys is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 1, 2004
posts:3181
votes: 0


I noticed the same thing too this month. MSN was spidering our site very hard. Through the first 14 days of the month, they grabbed around 17,000 pages on a 1,400 page site.
10:26 am on Oct 25, 2009 (gmt 0)

Preferred Member

10+ Year Member Top Contributors Of The Month

joined:July 23, 2004
posts:472
votes: 35


I'm wondering why Microsoft is using so many unidentified useragents ..