Forum Moderators: Robert Charlton & goodroi
On my site I have a directory I will call metal, and in that directory are many sub directories that contain only the graphics for the html pages that are contained inside the directory metal.
My question is this, should the indexes for the subdirectories of the metal directory be on so that the googlebot can crawl the graphics and anyone can type www.mysite.com/directoryname/ and see what is in that directory or should they be off and only the html pages can be crawled and the snoopers kept out.
If you want a set of images indexed, make a site map with links whose text describes them.
Use robots.txt to inform Google and other search engines of what they should and should not index. Directory browsing is great for ftp sites, but that's pretty much it.
