ia_archiver

Who is that?

[ideavirus]

Hii,

I see this agent ia_archiver visiting my site in my log files for most of my sites...!

Which SE sends out such an agent/bot...?? anybody has an idea??

Thanks

[bobriggs]

See www.archive.org

Try a site search on ia_archiver. There's a lot of stuff here about it.

[bobmark]

ia_archiver is Alexa. What I have never quite been able to figure out is why they spider your whole site but don't operate their own search engine. You got to think they are selling the results to somebody as why spider otherwise? They DO have some sort of corporate relationship with Google, I think.

[bobriggs]

You got to think they are selling the results to somebody as why spider otherwise?

Don't know if they're selling, but the results go to archive.org

[webmasterworld.com...]