homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

Blocking image file indexing without robots.txt
Can this be done?

10+ Year Member

Msg#: 62 posted 12:06 am on Jul 31, 2003 (gmt 0)

I know a robots.txt file can effectively block image indexing by blocking access to certain directories or filetypes, but can this be done without robots.txt (for example, in a situation where root level access is not possible)?

For instance, would funneling access to all of the pages with images on them through a gateway page bearing the meta tag robots="none" effectively protect the image files beyond from common robots -- even if the pages they are on have links backward to the main content?



WebmasterWorld Administrator brett_tabke us a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Msg#: 62 posted 8:08 pm on Oct 28, 2003 (gmt 0)

Yes, check the htaccess/apache forum for info on mod_rewrite. You can check the http referrer of the vistor and block access if you don't find it.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved