Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Scraper Site Clearout Collateral Damage?


Webdetective - 11:49 pm on Aug 17, 2005 (gmt 0)


Regarding googlebot spidering my possibly banned site, it is spidering other pages on my site, but just it's respidering index.html rather frequently. I should have been more clear on this earlier.

I assumed the frequent respidering of my homepage was due to googlebot attempting to respider missing pages from Google's cache, but being redirected to my homepage since I have a custom 404 redirect back to my homepage in my .htaccess file. Maybe I should disable my custom 404 redirect, so that my webhost's default redirect takes over until googlebot is finished spidering everything.


Thread source:: http://www.webmasterworld.com/google/30571.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com