| Why do I see so many MSNBot Spiders?
|
Marvin Hlavac
msg:4010796 | 1:54 pm on Oct 21, 2009 (gmt 0) |
My 2 year old site used to get between 300 to 600 pages viewed by MSNBot Spiders daily. However, starting September 17th the number of page views by MSNBot Spiders jumped to between 2,500 and 3,000. It has been at this high level ever since (about 5 weeks now). I never received much traffic from Microsoft's search engines, and it still is just a small percentage of my over all traffic. Is there any explanation for this unusually high MSNBot Spider traffic?
|
Marvin Hlavac
msg:4011131 | 10:44 pm on Oct 21, 2009 (gmt 0) |
... and why am I asking the above question? Well, this very minute I have 83 visitors on my site: * 37 people
* 1 Yahoo! Slurp Spider
* 1 Google Spider
* 1 AskJeeves Spider
* 43 MSNBot Spiders Why so many MSNBot Spiders?
|
BillyS
msg:4011822 | 9:13 pm on Oct 22, 2009 (gmt 0) |
I noticed the same thing too this month. MSN was spidering our site very hard. Through the first 14 days of the month, they grabbed around 17,000 pages on a 1,400 page site.
|
mcneely
msg:4012997 | 10:26 am on Oct 25, 2009 (gmt 0) |
I'm wondering why Microsoft is using so many unidentified useragents ..
|
|
|
