Forum Moderators: open
robots.txt? NO
Related: amazonaws.com plays host to wide variety of bad bots [webmasterworld.com]
robots.txt? NO
This is the first time I've noticed an AWS-bot hitting more than once over time -- in this case, ~5 weeks -- from the exact same IP. Cloud IP space is supposed to be amorphous.
-----
IP-in-Host (per usual w/ AWS): 75.101.232.27
75.101.128.0 - 75.101.255.255
CIDR: 75.101.128.0/17