homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

robots.txt and template pages
Does blocking templates prevent spiders from following links?

 8:18 am on Feb 11, 2004 (gmt 0)

I have a directory of php template files under the disallow directive, believing that I don't want a spider indexing my template files. By doing that however, am I blocking a spider from following legitimate links?

In other words, if 'm blocking /templates/ (the templates directory), am I preventing a spider that traverses the front page from following /templates/article.php?id=1



 12:59 am on Feb 12, 2004 (gmt 0)

Hi, Welcome to WW,
I guess it depends on what you use but for Dreamweaver at least, the template's code is written into each page; the template file(s) do not need to be uploaded to your remote server.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved