my sites have been getting crawled by alexa very agressively in the last few weeks. anyone else notice this.
does anyone know what they are doing with it. Their search in their toolbar just delivers goto listings. maybe they want to add their own stuff to the goto listings they display. Anyone has ideas on how many searches they get?
Alexa has been far more agressive lately. The other day, I was working on some not-for-public content. After uploading and testing some pages, I went to lunch.
When I came back, a glanced at my log files and saw that Alexa had spidered every single page I had just published, and they crawled it in the exact orger I viewed the pages. (I have their toolbar installed on this particular computer).
Now I've always been aware of the fact that data transmitted through the toolbar was used for crawls, but I don't ever recall noticing that they follow individual users so closely. (Keep in mind that I'm the only human being to ever look at the pages Alexa has been hammering).
Alexa is to the web what TRW and Equifax are to the financial world...they collect information about you without your consent. If you've ever seen the profiles Alexa has for each web site they crawl you would know what I mean.
The difference is this one little line can help your privacy:
Well now I know more about ia_archiver I think I'll ban it as well.
I've just looked that the homepage of alexa.com and seen that they've been a little bit naughty and have been taken to court. Anyone in the US who has downloaded and used the Alexa toolbar (pre v5) may be able to submit a claim. See the link on the homepage about court action.