Msg#: 4459202 posted 9:42 pm on May 29, 2012 (gmt 0)
Today, plain clothes came along but unlike other visits where it requests bot accessible pages it only tried to access pages that are either rel=nofollow and noindex (etc) or that are in directories which are disallowed to the bots.
22.214.171.124 -- Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.40607; .NET CLR 3.0.04506.648)
126.96.36.199 -- Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; SV1; .NET CLR 1.1.4325)
188.8.131.52 -- Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.2; SV1; .NET CLR 1.1.4325; .NET CLR 2.0.50727; .NET CLR 3.0.04506.648)
All UAs have double spaces before SV1 and SLCC1 and every .NET
The last visit topped it all with the bot stepping into my honeypot :o)
It really annoys me in that Bing claims their lack of crawling many pages of a site is due to a lack of resources and yet they are wasting those same resources for shenanigans like this for it can not possibly be that this happens on my site alone.