homepage Welcome to WebmasterWorld Guest from 54.196.195.158
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
MSN spidering without proper UA
zerillos




msg:4399673
 10:46 am on Dec 20, 2011 (gmt 0)

Hi guys,

I'm not really sure if this is regular practice with MSN (Bing) or not. Since a few weeks back, they've been spidering my website without a proper User Agent (meaning their UA does NOT say anything about bingbot. It's just a regular browser UA). This happens from three different IP ranges. Yes, I've checked thoroughly and the IP rangers are registered under MSN.

I doubt this is manual review, since it doesn't look at all as normal human behavior.

Did they officially stop declaring their bots in User Agent strings?

Thanks!

 

engine




msg:4399739
 2:44 pm on Dec 20, 2011 (gmt 0)

There are some significant discussions on the stealth of the bots.

MSN's Stealth Missions [webmasterworld.com]
MSN's many cloaked bots. Again. [webmasterworld.com]

zerillos




msg:4399973
 6:57 am on Dec 21, 2011 (gmt 0)

Thanks for pointing me in the right direction.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved