homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

Increase in msnbot activty?
Anyone else see an increase in msnbot hits in first week of Oct-2004

10+ Year Member

Msg#: 201 posted 11:45 pm on Oct 4, 2004 (gmt 0)

I'm seeing a few hits a second from the msnbot that started over the past couple days - anyone else seeing this activity? This is strange because the msnbot is even heavily spidering new URLs. With Yahoo and (especially) Google I wait weeks or months for more than a few dozen hits from a spider.



10+ Year Member

Msg#: 201 posted 3:58 am on Oct 5, 2004 (gmt 0)
iblaine: For one 24 hour period, I found the following bot activity:

MSNbot: 50 files including robots.txt
Googlebot: 52 files, ditto.
Y-slurp: 29 files, ditto.

These ratios go up and down every day for me, but MSN does look busier than previously, yes. - Larry

Global Options:
 top home search open messages active posts  

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved