homepage Welcome to WebmasterWorld Guest from 54.167.173.250
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
getting hammered by tide544.microsoft.com today
bakedjake




msg:4427142
 8:21 pm on Mar 9, 2012 (gmt 0)

... well relatively hammered. Certainly more than I would expect.

IP: 131.107.0.114
UA: "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)"

It's crawling landing pages; it has requested each landing page about 20 times today. But it keeps doing it over and over again, like it's expecting something different to happen.

And the requests are becoming more frequent as the day goes on.

 

lucy24




msg:4427224
 2:39 am on Mar 10, 2012 (gmt 0)

Curious. Quick search through raw logs tells me I've had precisely one recent visit from this range.

131.107.0.114, apparent human*, a few weeks ago, via-- hmmmmm --Bing search.

UA-- double hmmmmm --Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)

Is your guy getting only the page, or the associated files as well?


* All subsidiary files plus piwik; plausible search string.

wilderness




msg:4427233
 3:36 am on Mar 10, 2012 (gmt 0)

This Class C has long been a proving grounds for MS Products, in fact, there are multiple old threads from 2003, and when MSN began crawling unidentified from this IP as they prepared to enter the SE world.

FWIW, I was just teasing keyplr about this range in another thread.

dstiles




msg:4427648
 10:30 pm on Mar 10, 2012 (gmt 0)

I've had 131.107/16 blocked for ever-ish. Certainly several years. I'm not even sure it's true MS - the activity I used to see was very scraper-ish and looked more like leased server activity.

wilderness




msg:4427653
 10:34 pm on Mar 10, 2012 (gmt 0)

dstiles,
You may be correct about the ownership, I didn't check.

However, when MS started using that IP in 2003, the range wasn't registered to them either.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved