Welcome to WebmasterWorld Guest from 54.166.189.88

Forum Moderators: goodroi

Message Too Old, No Replies

Alexa (IA Archiver)

How do I excluse it

     
3:17 am on Feb 10, 2005 (gmt 0)

Preferred Member

10+ Year Member

joined:July 5, 2004
posts:470
votes: 0


That should be... how do I exclude it?

User-agent: Alexa
Disallow: /

Is this enough?

3:21 am on Feb 10, 2005 (gmt 0)

Senior Member from CA 

WebmasterWorld Senior Member encyclo is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Aug 31, 2003
posts:9074
votes: 6


That won't work as you need to specify ia_archiver rather than Alexa. Try:

User-agent: ia_archiver
Disallow: /

Details here: [archive.org...]

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members