Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Kilobytes downloaded per day vs Pages crawled per day

goodroi - 12:19 pm on Feb 22, 2010 (gmt 0)


a simplified way to check this is to search on google for your website and then click on the cache link. that will show you what google grabbed and the date they grabbed it.

Thread source:: http://www.webmasterworld.com/robots_txt/4081279.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com