Page is a not externally linkable
OutdoorMan - 6:38 pm on Oct 29, 2006 (gmt 0)
My stats (AW stats) shows frequently Googlebot activities on my site, but I can't actually see if there are any direct hits on my Home Page. My Home Page is adressed as www.example.com -- and I don't adress it as either /default.asp or /index.asp I recently have had such an issue [webmasterworld.com] a few weeks ago, due to a bad 301 redirect script, wich had the result that Google added my /default.asp to their index. I solved (I believe) the problem by renaming my /default.asp as /index.asp and added the following in my robots.txt: User-agent: * Wich should prevent robots from indexing my Home Page as /default.asp or /index.asp. Yes, all of my internal links points at www.example.com when adressing my Home Page. I have changed some of the tekst on my Home Page for about two weeks ago. Thank you for your time! [edited by: OutdoorMan at 6:57 pm (utc) on Oct. 29, 2006]
Thanks for your post, Tedster. What do your logs say -- has googlebot requested your Home Page since Aug 31? 1. Does the domain root resolve directly as your page, or does it redirect to an inner URL?
Disallow: /Index.asp$
Disallow: /Default.asp$ 2. Do all your Home links in the site point to the domain root, rather than to "index.php" or whatever the filename is? 3. Have you updated the Home Page in any way? This "shouldn't" matter -- but when the content is not modified since the last crawl, there's a new method for handling cache dates being worked out. That might still be buggy.