Welcome to WebmasterWorld Guest from 54.234.38.8

Forum Moderators: phranque

Message Too Old, No Replies

Getting on archive.org

     
11:07 pm on Oct 5, 2009 (gmt 0)

New User

10+ Year Member

joined:Mar 21, 2003
posts: 32
votes: 0


I have a site that's been active since 2007, and it's still not on archive.org. I've seen ia_archiver in awstats a lot of times, so i don't know what's wrong. Any idea how i can get my pages on there?
11:26 pm on Oct 5, 2009 (gmt 0)

Senior Member from FR 

WebmasterWorld Senior Member leosghost is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Feb 15, 2004
posts:6717
votes: 230


curiosity :)..why would you want on be on there ?
11:41 pm on Oct 5, 2009 (gmt 0)

New User

5+ Year Member

joined:Oct 5, 2009
posts:2
votes: 0


Just to check the obvious, you don't have a robots noarchive instruction on those pages, right?
2:47 am on Oct 6, 2009 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10544
votes: 8


have you checked your robots.txt file for relevant exclusions?

you should check the Internet Archive Frequently Asked Questions [archive.org] or you can try filling out the form to be crawled by Alexa [alexa.com].

4:08 am on Oct 6, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 20, 2004
posts:2377
votes: 0


Getting your pages listed there is more trouble than it is worth. Once they get them, they will always be public... Even if you delete them.

Be careful what you wish for... =)

3:45 am on Oct 7, 2009 (gmt 0)

New User

10+ Year Member

joined:Mar 21, 2003
posts: 32
votes: 0


curiosity :)..why would you want on be on there ?

In case someone steals my articles, or if someone accuses me of stealing.




you don't have a robots noarchive instruction on those pages, right?

I don't use that on any of my pages.




have you checked your robots.txt file for relevant exclusions?

I have 17 bots blocked in there, but none of them are ia_archiver.




you can try filling out the form to be crawled by Alexa

I did that a long time ago.

5:02 am on Oct 7, 2009 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 29, 2005
posts:6160
votes: 284


Make sure your server is not sending a x-robots header.... (probably not). Me and Wayback Machine parted company many years back.