homepage Welcome to WebmasterWorld Guest from 184.72.82.126
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Alternative Search Engines
Forum Library, Charter, Moderators: bakedjake

Alternative Search Engines Forum

    
msnbot
404ing with strange requests
Unca_Tim




msg:462166
 4:00 am on Feb 8, 2004 (gmt 0)

Any idea what M$N was up to here? I've had several requests today from M$N with similar addresses.

Agent: msnbot/0.11 (+http://search.msn.com/msnbot.htm)

Url: /&y=02DEB59A8814CD58&i=322&c=6131&q=02%5ESSHPM%5BL7%7Bvzk%3Fhzvxwk%3Fspll%3Fspx6&e=utf-8&r=7&d=&n=8AL45H5RF81K1SMO&s=0&t=&m=4003841A&x=0117F391B3C1316F

 

Visi




msg:462167
 4:01 am on Feb 10, 2004 (gmt 0)

Well something...unidentified from Microsoft is out pulling pages...IP 65.54.188.33. Anyone else seen this one?

anchordesk




msg:462168
 5:10 am on Feb 10, 2004 (gmt 0)

msnbot has been deep crawling my sites in the last few weeks.

65.54.188.15
65.54.188.30
65.54.188.33
65.54.188.40

Wondering myself what and where and how to access what he's indexing. Checked all logical, found nothing.

papamaku




msg:462169
 9:31 am on Feb 11, 2004 (gmt 0)

been hit hard the last couple of days from:

65.54.188.31

Powdork




msg:462170
 9:35 am on Feb 11, 2004 (gmt 0)

Yesterday she grabbed about 1/3 of my site and it was the deep 1/3.

domingo




msg:462171
 4:33 pm on Feb 11, 2004 (gmt 0)

I am facing the same situation, msnbot 0.11 spending most of the time on site. I have a question

1. Where will the results be used

If nowhere, is it feasible to ban it for now

asinah




msg:462172
 3:29 pm on Feb 12, 2004 (gmt 0)

I noted it as well for the past 5 days. Got crawled about 450,000 pages already and another 1.5 million pages to go.

I do hope that they will add one day the crawled pages to their index, otherwsie it is a waste of bandwidth as they have taken around 7gb per day for the past 5 days.

Robino




msg:462173
 3:31 pm on Feb 12, 2004 (gmt 0)


65.54.188.17 has been on one of my sites for 38 hours.

And, it has a $200,000 shopping cart in progress with over 300 items in it.

I hope Mr. Gates has room on his credit card.


Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Alternative Search Engines
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved