Page is a not externally linkable
Webdetective - 11:49 pm on Aug 17, 2005 (gmt 0)
I assumed the frequent respidering of my homepage was due to googlebot attempting to respider missing pages from Google's cache, but being redirected to my homepage since I have a custom 404 redirect back to my homepage in my .htaccess file. Maybe I should disable my custom 404 redirect, so that my webhost's default redirect takes over until googlebot is finished spidering everything.
Regarding googlebot spidering my possibly banned site, it is spidering other pages on my site, but just it's respidering index.html rather frequently. I should have been more clear on this earlier.