Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Kilobytes downloaded per day vs Pages crawled per day
goodroi - 12:19 pm on Feb 22, 2010 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4081279.htm
a simplified way to check this is to search on google for your website and then click on the cache link. that will show you what google grabbed and the date they grabbed it.
Brought to you by WebmasterWorld: http://www.webmasterworld.com