Page is a not externally linkable
-- Webmaster General
---- Redirect subdirectory index pages?
not2easy - 3:03 pm on Sep 17, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/webmaster/4496119.htm
|Wouldn't it be more practical to switch off auto-indexing |
Thank you, but I guess I was not very clear. The directory used to contain only images so the dummy indexes were put in because the rest of the site does use a structure that is set up to serve an index file when a directory is accessed. It now contains pages and images. If I use -Indexes I would need to make less preferred changes to the directories that are using regular index.html for years. Currently as phranque said, when you access a directory an index.html file is served. For years I had the dummy index in there just so the server would not serve up a list of images. My only controls are via .htaccess and it seems more complicated than need be to turn off Indexes in some subdirectories only.
That is exactly right, just wondering if I am better off redirecting the index.html file to the what-is-here.html page in each subdirectory or renaming what-is-here.html to index.html
|from your description it sounds like the content in the what-is-here.html file should actually be in the index.html file |
I am not having this problem, but I can see where the confusion is. The index.html pages are not being indexed, they do not appear in the sitemap and I'm sure they are crawled and ignored. They are not blocked in robots.txt. My problem was that although the index.html files are not in my sitemap, the subdirectories are listed and if crawled, that URL would serve up a dummy index.html file. I can control what goes in the sitemap by file extension but folders/directories are only either on or off, I can't list every page in a subdirectory without listing the subdirectory as an URL too.
|regarding your meta noindexed content showing up in the index |
Yes, it is not images that concern me, but you just gave me an idea.. If I rename the index.html pages to index.php they will not be giving the subdirectory URLs to the sitemap script because .php files are ignored and I would not need to do anything else. My htaccess is only redirecting requests for index.html to the subdirectory URL. If I rename them to index.php that should keep the subdirectories out of my sitemap.
|Can't you tell your sitemap script to index only files with certain extensions? If there's nothing in there but images, there's no reason for it to be on the sitemap at all. G### will find the individual images; they're linked from pages. |
Thank you lucy24 and phranque for the help, just needed some different ideas on this because I was not seeing what is in front of me.
Brought to you by WebmasterWorld: http://www.webmasterworld.com