Welcome to WebmasterWorld Guest from 54.166.80.147

Forum Moderators: bakedjake

Message Too Old, No Replies

msnbot

404ing with strange requests

     
4:00 am on Feb 8, 2004 (gmt 0)

New User

10+ Year Member

joined:Aug 5, 2003
posts:18
votes: 0


Any idea what M$N was up to here? I've had several requests today from M$N with similar addresses.

Agent: msnbot/0.11 (+http://search.msn.com/msnbot.htm)

Url: /&y=02DEB59A8814CD58&i=322&c=6131&q=02%5ESSHPM%5BL7%7Bvzk%3Fhzvxwk%3Fspll%3Fspx6&e=utf-8&r=7&d=&n=8AL45H5RF81K1SMO&s=0&t=&m=4003841A&x=0117F391B3C1316F

4:01 am on Feb 10, 2004 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 23, 2002
posts:602
votes: 0


Well something...unidentified from Microsoft is out pulling pages...IP 65.54.188.33. Anyone else seen this one?
5:10 am on Feb 10, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Aug 8, 2003
posts:62
votes: 0


msnbot has been deep crawling my sites in the last few weeks.

65.54.188.15
65.54.188.30
65.54.188.33
65.54.188.40

Wondering myself what and where and how to access what he's indexing. Checked all logical, found nothing.

9:31 am on Feb 11, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 31, 2003
posts:194
votes: 0


been hit hard the last couple of days from:

65.54.188.31

9:35 am on Feb 11, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member powdork is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Sept 13, 2002
posts:3347
votes: 0


Yesterday she grabbed about 1/3 of my site and it was the deep 1/3.
4:33 pm on Feb 11, 2004 (gmt 0)

Junior Member

10+ Year Member

joined:May 25, 2002
posts:49
votes: 0


I am facing the same situation, msnbot 0.11 spending most of the time on site. I have a question

1. Where will the results be used

If nowhere, is it feasible to ban it for now

3:29 pm on Feb 12, 2004 (gmt 0)

Full Member

10+ Year Member

joined:July 11, 2003
posts:291
votes: 0


I noted it as well for the past 5 days. Got crawled about 450,000 pages already and another 1.5 million pages to go.

I do hope that they will add one day the crawled pages to their index, otherwsie it is a waste of bandwidth as they have taken around 7gb per day for the past 5 days.

3:31 pm on Feb 12, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 19, 2002
posts:1018
votes: 0



65.54.188.17 has been on one of my sites for 38 hours.

And, it has a $200,000 shopping cart in progress with over 300 items in it.

I hope Mr. Gates has room on his credit card.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members