| Welcome to WebmasterWorld Guest from 188.8.131.52 |
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
|Become a Pro Member|
|Archive.org :: What's the deal?|
Why hasn't it visited me in sooo long?
| 9:34 am on Jan 12, 2003 (gmt 0)|
My site was archived a number of times throughout 2001, but it hasn't touched me since.
Anyone know why? .. and how to invite it back?
| 10:40 am on Jan 12, 2003 (gmt 0)|
Vidman, welcome to WebmasterWorld,
Check this thread:
It seems they are always 6 months behind at least.
| 11:12 pm on Jan 13, 2003 (gmt 0)|
The Internet Archive gets its data from Alexa. Check to see if Alexa has crawled you by checking your logs for "ia_archiver".
Alexa donates its crawl to the Internet archive after 6 months, so the Wayback Machine will never have the most recent stuff...
| 11:21 pm on Jan 13, 2003 (gmt 0)|
You may want to check your robots.txt file and make sure you have not disallowed the bot.
| 6:07 am on Jan 14, 2003 (gmt 0)|
Thanks for not reaming me out for not searching previous threads :)
My robots.txt contains:
Thanks for the log tip... I'll write a script to check it on a daily basis.
| 2:14 am on Jan 18, 2003 (gmt 0)|
I see it crawling my site :)
All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved