homepage Welcome to WebmasterWorld Guest from 54.167.138.53
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
getting hammered by tide544.microsoft.com today
bakedjake

WebmasterWorld Administrator bakedjake us a WebmasterWorld Top Contributor of All Time 10+ Year Member



 
Msg#: 4427140 posted 8:21 pm on Mar 9, 2012 (gmt 0)

... well relatively hammered. Certainly more than I would expect.

IP: 131.107.0.114
UA: "Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)"

It's crawling landing pages; it has requested each landing page about 20 times today. But it keeps doing it over and over again, like it's expecting something different to happen.

And the requests are becoming more frequent as the day goes on.

 

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4427140 posted 2:39 am on Mar 10, 2012 (gmt 0)

Curious. Quick search through raw logs tells me I've had precisely one recent visit from this range.

131.107.0.114, apparent human*, a few weeks ago, via-- hmmmmm --Bing search.

UA-- double hmmmmm --Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0)

Is your guy getting only the page, or the associated files as well?


* All subsidiary files plus piwik; plausible search string.

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4427140 posted 3:36 am on Mar 10, 2012 (gmt 0)

This Class C has long been a proving grounds for MS Products, in fact, there are multiple old threads from 2003, and when MSN began crawling unidentified from this IP as they prepared to enter the SE world.

FWIW, I was just teasing keyplr about this range in another thread.

dstiles

WebmasterWorld Senior Member dstiles us a WebmasterWorld Top Contributor of All Time 5+ Year Member



 
Msg#: 4427140 posted 10:30 pm on Mar 10, 2012 (gmt 0)

I've had 131.107/16 blocked for ever-ish. Certainly several years. I'm not even sure it's true MS - the activity I used to see was very scraper-ish and looked more like leased server activity.

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4427140 posted 10:34 pm on Mar 10, 2012 (gmt 0)

dstiles,
You may be correct about the ownership, I didn't check.

However, when MS started using that IP in 2003, the range wasn't registered to them either.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved