| Welcome to WebmasterWorld Guest from 220.127.116.11 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|MsnBot failing DNS lookup|
IP address is registered to Microsoft Corp
| 7:58 am on Dec 19, 2007 (gmt 0)|
finally we've managed to set up a reverse forward look up on our server,
I've had many visit from this ip range 65.55.234.* which fails on the first hurdle which is to match the DNS this is what i'm getting:
Resolve Host: bl1sch2042001.phx.gbl
so is this a legit Bot and if so is any one else seeing this is from MSN ip range.
18.104.22.168 - 22.214.171.124
They give us a formula and then change the goal posts ;)
| 8:12 am on Dec 19, 2007 (gmt 0)|
They're running rogue bots that emulate browsers (aka user agent spoofing), and that don't honor robots.txt or <meta name="robots" content="noindex,nofollow">.
Ostensibly, the purpose is to detect cloaking, but that bot of theirs doesn't have proper etiquette or good manners.
This thread might be of interest:
[edited by: Marcia at 8:16 am (utc) on Dec. 19, 2007]
| 7:17 am on Dec 20, 2007 (gmt 0)|
good to know they might fix it,
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved