wilderness
msg:4515139 | 6:09 pm on Nov 2, 2012 (gmt 0) |
Pfui has a long and dedicated thread [webmasterworld.com]
|
bigtoga
msg:4515145 | 6:14 pm on Nov 2, 2012 (gmt 0) |
Yes, I've seen that - thank you. I'm not sure though whether Amazon has its own crawler?
|
wilderness
msg:4515149 | 6:25 pm on Nov 2, 2012 (gmt 0) |
Nor am I, unfortunately their hosting business customers have a proven record of abuse, as does Amazon AWS' acceptance of these customers.
Perhaps the Amazon FAQ (NOT Amazon AWS) provides the answer.
The easiest explanation is within your raw visitor logs and the image references to your own Amazon pages.
What are those IP's?
Simply separate them from the Amazon AWS IP's.
|
keyplyr
msg:4515184 | 8:09 pm on Nov 2, 2012 (gmt 0) |
It used to be call "A1" but haven't seen that UA for a while.
Then there were versions of "AWSpider" (AWSpider 0.3.2.12 last hit my logs in 2011.)
|
Bewenched
msg:4516059 | 9:35 pm on Nov 5, 2012 (gmt 0) |
I've busted several amazon "bots" scraping our site for images.... makes me wonder if they are actually stealing product images from sites for their own use.
|
wilderness
msg:4516078 | 10:52 pm on Nov 5, 2012 (gmt 0) |
bots don't exactly leave resumes ;)
Harvesting, plagiarizing or simply indexing, who knows the why?
The AWS customers hit us all, that's why the long threads exist.
|
keyplyr
msg:4516178 | 5:54 am on Nov 6, 2012 (gmt 0) |
| The AWS customers hit us all, that's why the long threads exist. |
|
Yes, but we're discussing "Amazon" bots.
|
wilderness
msg:4516201 | 6:57 am on Nov 6, 2012 (gmt 0) |
My bad, hope it's just a full moon ;)
|
|
