homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Alternative Search Engines
Forum Library, Charter, Moderators: bakedjake

Alternative Search Engines Forum

404ing with strange requests

 4:00 am on Feb 8, 2004 (gmt 0)

Any idea what M$N was up to here? I've had several requests today from M$N with similar addresses.

Agent: msnbot/0.11 (+http://search.msn.com/msnbot.htm)

Url: /&y=02DEB59A8814CD58&i=322&c=6131&q=02%5ESSHPM%5BL7%7Bvzk%3Fhzvxwk%3Fspll%3Fspx6&e=utf-8&r=7&d=&n=8AL45H5RF81K1SMO&s=0&t=&m=4003841A&x=0117F391B3C1316F



 4:01 am on Feb 10, 2004 (gmt 0)

Well something...unidentified from Microsoft is out pulling pages...IP Anyone else seen this one?


 5:10 am on Feb 10, 2004 (gmt 0)

msnbot has been deep crawling my sites in the last few weeks.

Wondering myself what and where and how to access what he's indexing. Checked all logical, found nothing.


 9:31 am on Feb 11, 2004 (gmt 0)

been hit hard the last couple of days from:


 9:35 am on Feb 11, 2004 (gmt 0)

Yesterday she grabbed about 1/3 of my site and it was the deep 1/3.


 4:33 pm on Feb 11, 2004 (gmt 0)

I am facing the same situation, msnbot 0.11 spending most of the time on site. I have a question

1. Where will the results be used

If nowhere, is it feasible to ban it for now


 3:29 pm on Feb 12, 2004 (gmt 0)

I noted it as well for the past 5 days. Got crawled about 450,000 pages already and another 1.5 million pages to go.

I do hope that they will add one day the crawled pages to their index, otherwsie it is a waste of bandwidth as they have taken around 7gb per day for the past 5 days.


 3:31 pm on Feb 12, 2004 (gmt 0) has been on one of my sites for 38 hours.

And, it has a $200,000 shopping cart in progress with over 300 items in it.

I hope Mr. Gates has room on his credit card.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Alternative Search Engines
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved