Forum Moderators: open
robots.txt? NO
I suspect there've been other IPs I've missed but a quick grep of recent days' logs showed that Microsoft IP hitting x2, four days apart. I spotted the hits because they were simultaneous with Twitter referer spatter.
No graphics, no favicons, no referers. Just GETs to the same just-Tweeted pages the usual 10 or so bots hit at the same time.*
Googling the IP shows tell-tale references to bot hits, as in: "Your IP Address is: 70.37.13.98."
Not that MSN gives a hoot about cloaking itself, of course. But I though y'all might want to know.
-----
*On my sites, most Twitter trackers come from .amazonaws.com (see thread [webmasterworld.com]) --
[client 174.129.243.238] denied - bitlybot
[client 174.129.115.46] denied - Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0)
[client 174.129.111.78] denied - PycURL/7.18.2
[client 174.129.141.109] denied - (blank)
[client 174.129.89.199] denied - Python-urllib/2.5
--then me.dium --
nym-ppp46.lvdi.net
nym-ppp47.lvdi.net
(using)
Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1) Gecko/20061010 Firefox/2.0 Me.dium/1.0 (http://me.dium.com)
-- then a motley crew of startitup-sellit-getrichquick lookalikes.
