Archive.org :: What's the deal?

Why hasn't it visited me in sooo long?

[Vidman]

My site was archived a number of times throughout 2001, but it hasn't touched me since.

Anyone know why? .. and how to invite it back?

-=vidmån=-

[vitaplease]

Vidman, welcome to WebmasterWorld,

Check this thread:

[webmasterworld.com...]

It seems they are always 6 months behind at least.

[duncan12]

The Internet Archive gets its data from Alexa. Check to see if Alexa has crawled you by checking your logs for "ia_archiver".

Alexa donates its crawl to the Internet archive after 6 months, so the Wayback Machine will never have the most recent stuff...

[Mardi_Gras]

You may want to check your robots.txt file and make sure you have not disallowed the bot.

[Vidman]

Thanks for not reaming me out for not searching previous threads :)

My robots.txt contains:

User-agent: *
Disallow: /cgi-bin/ 

Thanks for the log tip... I'll write a script to check it on a daily basis.

[Vidman]

*woohoo*

I see it crawling my site :)