Forum Moderators: goodroi

Message Too Old, No Replies

Alexa (IA Archiver)

How do I excluse it

         

Rollo

3:17 am on Feb 10, 2005 (gmt 0)

10+ Year Member



That should be... how do I exclude it?

User-agent: Alexa
Disallow: /

Is this enough?

encyclo

3:21 am on Feb 10, 2005 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



That won't work as you need to specify ia_archiver rather than Alexa. Try:

User-agent: ia_archiver
Disallow: /

Details here: [archive.org...]