vitaplease
msg:359163 | 10:40 am on Jan 12, 2003 (gmt 0) |
Vidman, welcome to WebmasterWorld, Check this thread: [webmasterworld.com...] It seems they are always 6 months behind at least.
|
duncan12
msg:359164 | 11:12 pm on Jan 13, 2003 (gmt 0) |
The Internet Archive gets its data from Alexa. Check to see if Alexa has crawled you by checking your logs for "ia_archiver". Alexa donates its crawl to the Internet archive after 6 months, so the Wayback Machine will never have the most recent stuff...
|
Mardi_Gras
msg:359165 | 11:21 pm on Jan 13, 2003 (gmt 0) |
You may want to check your robots.txt file and make sure you have not disallowed the bot.
|
Vidman
msg:359166 | 6:07 am on Jan 14, 2003 (gmt 0) |
Thanks for not reaming me out for not searching previous threads :) My robots.txt contains: User-agent: *
Disallow: /cgi-bin/ Thanks for the log tip... I'll write a script to check it on a daily basis.
|
Vidman
msg:359167 | 2:14 am on Jan 18, 2003 (gmt 0) |
*woohoo* I see it crawling my site :)
|
|
