ia_archiver who gets results? Freshbot?

Wondering who buys Alexa results...

[xerxes]

Hi, trying to attract Freshbot today, I updated a lot of pages. Then I saw in the log that ia_archiver, which this forum has previously identified as Alexa, is coming to visit robots.txt and each page I updated (AS WELL as old pages at random).

I saw in an old post that Alexa has a corporate tie to Google. Does anyone have any thoughts as to whether the ia-archiver visits are pre-cursors to a possible Freshbot visit? Like maybe a possibility that Alexa provides results to Freshbot? However, maybe Alexa is just caching pages and my idea is worthless. I will keep you posted in case I get a Freshbot visit (64.68.xx.xx) We SURE DO NEED one. Client tearing out what hair he has left, if any (hee, hee) Thanks for any input you may have, about Freshbot, ia_archiver, etc. not client's baldness, ha ha.

[Dreamquick]

ia_archiver is unrelated to Google's crawlers, it serves only alexa.com and archive.org and in my opinion is a waste of your bandwidth (a site search should provide more insight why myself & others feel like this).

- Tony

[pearl]

This from Amazon:
"In an effort to help you optimize your Web site(s), we're working with our wholly-owned subsidiary, Alexa Internet, Inc., to identify broken Amazon.com Associates links. Alexa will review your Web site(s) once a month to search for Amazon.com links and generate reports on their quality."

Amazon has also stated that ia_archiver does NOT respect robots.txt files

[xerxes]

Thank you, Dreamquick and Pearl for the kind clarifications. Much appreciated.

[nativenewyorker]

pearl said:

Amazon has also stated that ia_archiver does NOT respect robots.txt files

How old is that statement? I have ia_archiver in my robots.txt and they have not retrieved any of my other files.

Ted