Forum Moderators: open
I've had this fellow fell into my spider trap but keeps coming back after being 403'd.
The UA varies:
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Fetch API Request"
Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 5.0) Microsoft Scheduled Cache Content Download Service"
doesn't seem to look for robots.txt, at least not this month
I guess this isn't anything to do with m$ actually unless it is a product they are using?
It shows as a big block for covad com
and shows 'gobeam.com' lower down on whois
It's linked to spam harvesting and my suspicion is it's a toolkit, maybe an MS toolkit, being used for that purpose.
[google.com...]