| Welcome to WebmasterWorld Guest from 184.108.40.206 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Alexa crawler using requests for alexa rank for document discovery|
I'm not using the alexa toolbar but a firefox plugin...
| 4:02 pm on Apr 8, 2009 (gmt 0)|
...which does this request to alexa:
GET /data?cli=10&dat=nsa&ver=quirk-searchstatus&uid=20080619175053&userip=127.0.0.1&url=http%3A//example.com HTTP/1.1
I had a php script to send a newsletter which I ran through the browser for testing. And next day I had ia_archive knocking on my door...
Is this news or have I been living under a rock?
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved