homepage Welcome to WebmasterWorld Guest from 54.144.236.12
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
Forum Library, Charter, Moderators: Ocean10000 & incrediBILL

Search Engine Spider and User Agent Identification Forum

    
MsnBot
Cloaking - perhaps running a check on page content
Ken_S



 
Msg#: 4506906 posted 1:15 pm on Oct 11, 2012 (gmt 0)

Gooding Morning All (morning in my location anyway :-)

There are many references on this subject here at WW, thought I would add my comment as well.

Of late I have been paying more attention in the area of cloaking. After going over a couple of years of threads on this subject, it appears I would be correct in calling this a cloaked MsnBot?
I have seen this IP range many times in the past. I really don't have any site content or images of any value, well perhaps clients email addys. I try my upmost, with my limited understanding to protect my clients privacy, while knowing full well that if personal info is out on the web there are folks out there that know under the right conditions, they can get it.

It would be understandable that it could be a check to see if I am trying to slide something in under radar - I personally check a little deeper on things at times.

Microsoft - 207.46.0.0 - 207.46.255.255

msnbot-207-46-199-xx.search.msn.com

* MsnBot
207.46.199.xx - - [10/Oct/2012:21:07:12 -0700] "GET /example/example.htm HTTP/1.1" 200 1199 "-" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SLCC1; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.30729; .NET CLR 3.5.30729; InfoPath.2)"

Ken

 

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4506906 posted 6:27 pm on Oct 11, 2012 (gmt 0)

These UA's by MSN (Bing or otherwise) are primarily used for the Web Preview pages.

In addition, the UA's almost always are malformed with double trialing spaces and leading spaces to semi-colons.

Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; SV1;  .NET CLR 1.1.4325;  .NET CLR 2.0.50727;  .NET CLR 3.0.04506.648)

Ken_S



 
Msg#: 4506906 posted 7:12 pm on Oct 11, 2012 (gmt 0)

Wilderness

I will keep that in mind.
Thank you,
Ken

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4506906 posted 9:54 pm on Oct 11, 2012 (gmt 0)

primarily used for the Web Preview pages

Well, ###. I always assumed that if it's a preview it will openly call itself Bing Preview. (Rare, but does exist.)

wilderness

WebmasterWorld Senior Member wilderness us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



 
Msg#: 4506906 posted 10:47 pm on Oct 11, 2012 (gmt 0)

Well, ###. I always assumed that if it's a preview it will openly call itself Bing Preview. (Rare, but does exist.)


lucy,
Once again your mind is distracted by all that Apache Crap ;)
Just go back through old threads or search the archives.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Search Engine Spider and User Agent Identification
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved