Forum Moderators: open

Message Too Old, No Replies

mobile/; pda/ /iphone; . What does this bot want?

bot looking for directories like mobi/; m/; /images/ixcp.css

         

knonymouse

4:49 am on Jul 30, 2009 (gmt 0)

10+ Year Member



A parked site with no web presence except the two words in the index.html "under construction" - but does have an IP - should have nothing in its log.

July 28, a series of 28 requests came from one IP in the space of a minute. With some repetition, it was fishing for directories (non-existent on my site, so must be fishing)

"GET / HTTP/1.0"
"GET /images/ixcp.css HTTP/1.0"
also /apple-touch-icon.png
then duplicated above requests four more times
next
/m/
/mobile/
/mobi/
/iphone/
/pda/
then duplicated the directory request.

Four hours later all the same over again from a quite different IP.
One more hour and the first IP came back.
Both IPs had UA: "Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419.3"

Definitely a bot ... all requests in the same order. Didn't quit upon getting 404 error, just kept asking.

What's going on?

smallcompany

8:36 pm on Jul 30, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I see the same. I've been seeing it for quite some time and thought it was legitimate browser from iPhone and like devices, but for the last few days it looks quite crazy and like a bot.

I suggest this gets moved to "Search Engine Spider and User Agent Identification" so the thread continues in best possible way.

My question is why requesting those specific subfolders all the time?

Thanks

Pfui

7:30 pm on Jul 31, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I've seen the same multiple-file request sessions from .amazonaws.com x2 days on backwater sites. If yours came from there, too, see:

amazonaws.com plays host to wide variety of bad bots [webmasterworld.com]

ec2-[yada-yada].compute-1.amazonaws.com
Mozilla/5.0 (iPhone; U; CPU like Mac OS X; en) AppleWebKit/420+ (KHTML, like Gecko) Version/3.0 Mobile/1A543a Safari/419.3
07/30 04:18:09 /
07/30 04:18:28 /
07/30 04:19:03 /m/
07/30 04:19:05 /mobile/
07/30 04:19:06 /mobi/
07/30 04:19:06 /iphone/
07/30 04:19:09 /pda/
07/30 04:19:25 /m/
07/30 04:19:28 /mobile/
07/30 04:19:32 /mobi/
07/30 04:19:33 /iphone/
07/30 04:19:33 /pda/

As to what's going on, beats me. As to what I do about it -- 403. Definitely. Everything hailing from .amazonaws.com