Forum Moderators: open
July 28, a series of 28 requests came from one IP in the space of a minute. With some repetition, it was fishing for directories (non-existent on my site, so must be fishing)
"GET / HTTP/1.0"
"GET /images/ixcp.css HTTP/1.0"
also /apple-touch-icon.png
then duplicated above requests four more times
next
/m/
/mobile/
/mobi/
/iphone/
/pda/
then duplicated the directory request.
Four hours later all the same over again from a quite different IP.
One more hour and the first IP came back.
Both IPs had UA: "Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419.3"
Definitely a bot ... all requests in the same order. Didn't quit upon getting 404 error, just kept asking.
What's going on?
I suggest this gets moved to "Search Engine Spider and User Agent Identification" so the thread continues in best possible way.
My question is why requesting those specific subfolders all the time?
Thanks
amazonaws.com plays host to wide variety of bad bots [webmasterworld.com]
ec2-[yada-yada].compute-1.amazonaws.com
Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419.3
07/30 04:18:09 /
07/30 04:18:28 /
07/30 04:19:03 /m/
07/30 04:19:05 /mobile/
07/30 04:19:06 /mobi/
07/30 04:19:06 /iphone/
07/30 04:19:09 /pda/
07/30 04:19:25 /m/
07/30 04:19:28 /mobile/
07/30 04:19:32 /mobi/
07/30 04:19:33 /iphone/
07/30 04:19:33 /pda/
As to what's going on, beats me. As to what I do about it -- 403. Definitely. Everything hailing from .amazonaws.com