Welcome to WebmasterWorld Guest from 54.162.239.134

Forum Moderators: bakedjake

Message Too Old, No Replies

msnbot

404ing with strange requests

     
4:00 am on Feb 8, 2004 (gmt 0)

10+ Year Member



Any idea what M$N was up to here? I've had several requests today from M$N with similar addresses.

Agent: msnbot/0.11 (+http://search.msn.com/msnbot.htm)

Url: /&y=02DEB59A8814CD58&i=322&c=6131&q=02%5ESSHPM%5BL7%7Bvzk%3Fhzvxwk%3Fspll%3Fspx6&e=utf-8&r=7&d=&n=8AL45H5RF81K1SMO&s=0&t=&m=4003841A&x=0117F391B3C1316F

4:01 am on Feb 10, 2004 (gmt 0)

10+ Year Member



Well something...unidentified from Microsoft is out pulling pages...IP 65.54.188.33. Anyone else seen this one?
5:10 am on Feb 10, 2004 (gmt 0)

10+ Year Member



msnbot has been deep crawling my sites in the last few weeks.

65.54.188.15
65.54.188.30
65.54.188.33
65.54.188.40

Wondering myself what and where and how to access what he's indexing. Checked all logical, found nothing.

9:31 am on Feb 11, 2004 (gmt 0)

10+ Year Member



been hit hard the last couple of days from:

65.54.188.31

9:35 am on Feb 11, 2004 (gmt 0)

WebmasterWorld Senior Member powdork is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Yesterday she grabbed about 1/3 of my site and it was the deep 1/3.
4:33 pm on Feb 11, 2004 (gmt 0)

10+ Year Member



I am facing the same situation, msnbot 0.11 spending most of the time on site. I have a question

1. Where will the results be used

If nowhere, is it feasible to ban it for now

3:29 pm on Feb 12, 2004 (gmt 0)

10+ Year Member



I noted it as well for the past 5 days. Got crawled about 450,000 pages already and another 1.5 million pages to go.

I do hope that they will add one day the crawled pages to their index, otherwsie it is a waste of bandwidth as they have taken around 7gb per day for the past 5 days.

3:31 pm on Feb 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member




65.54.188.17 has been on one of my sites for 38 hours.

And, it has a $200,000 shopping cart in progress with over 300 items in it.

I hope Mr. Gates has room on his credit card.

 

Featured Threads

Hot Threads This Week

Hot Threads This Month