Welcome to WebmasterWorld Guest from 50.17.79.100

Forum Moderators: phranque

Message Too Old, No Replies

Getting on archive.org

     

markbiz

11:07 pm on Oct 5, 2009 (gmt 0)

10+ Year Member



I have a site that's been active since 2007, and it's still not on archive.org. I've seen ia_archiver in awstats a lot of times, so i don't know what's wrong. Any idea how i can get my pages on there?

Leosghost

11:26 pm on Oct 5, 2009 (gmt 0)

WebmasterWorld Senior Member leosghost is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



curiosity :)..why would you want on be on there ?

ChipD

11:41 pm on Oct 5, 2009 (gmt 0)

5+ Year Member



Just to check the obvious, you don't have a robots noarchive instruction on those pages, right?

phranque

2:47 am on Oct 6, 2009 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month



have you checked your robots.txt file for relevant exclusions?

you should check the Internet Archive Frequently Asked Questions [archive.org] or you can try filling out the form to be crawled by Alexa [alexa.com].

maximillianos

4:08 am on Oct 6, 2009 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Getting your pages listed there is more trouble than it is worth. Once they get them, they will always be public... Even if you delete them.

Be careful what you wish for... =)

markbiz

3:45 am on Oct 7, 2009 (gmt 0)

10+ Year Member



curiosity :)..why would you want on be on there ?

In case someone steals my articles, or if someone accuses me of stealing.




you don't have a robots noarchive instruction on those pages, right?

I don't use that on any of my pages.




have you checked your robots.txt file for relevant exclusions?

I have 17 bots blocked in there, but none of them are ia_archiver.




you can try filling out the form to be crawled by Alexa

I did that a long time ago.

tangor

5:02 am on Oct 7, 2009 (gmt 0)

WebmasterWorld Senior Member tangor is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



Make sure your server is not sending a x-robots header.... (probably not). Me and Wayback Machine parted company many years back.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month