| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Pubcon Platinum Sponsor 2014|
|Archive.org :: What's the deal?|
Why hasn't it visited me in sooo long?
My site was archived a number of times throughout 2001, but it hasn't touched me since.
Anyone know why? .. and how to invite it back?
Vidman, welcome to WebmasterWorld,
Check this thread:
It seems they are always 6 months behind at least.
The Internet Archive gets its data from Alexa. Check to see if Alexa has crawled you by checking your logs for "ia_archiver".
Alexa donates its crawl to the Internet archive after 6 months, so the Wayback Machine will never have the most recent stuff...
You may want to check your robots.txt file and make sure you have not disallowed the bot.
Thanks for not reaming me out for not searching previous threads :)
My robots.txt contains:
Thanks for the log tip... I'll write a script to check it on a daily basis.
I see it crawling my site :)
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved