webstuck - 2:50 am on Oct 4, 2012 (gmt 0)
I actually posted this here, but a replier suggested I post in a google forum for better help. [webmasterworld.com...]
I recently learned that Google was indexing folder URLs on my site (e.g. /shop/) because when you go to these URLs, the server returns a list of files within the folder. I didn't want these types of URLs indexed by Google. So, I added Options -Indexes to my .htaccess file. Since I also have ErrorDocument 403 /404.htm within my .htaccess, these URLs now redirect to my 404 error page. Unfortunately, that caused Access Denied errors to appear within Google webmaster tools. I have a couple of questions:
One, is adding Options -Indexes to .htaccess the best way to deal with these URLs or is there a better option such as somehow causing the URLs to return 404 instead of 403 status codes?
Two, if I leave these URLs as returning 403 status codes, will the Access Denied errors go away within Google webmaster tools?