homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

index.php vs index.html
Will This Work i Wonder

 9:18 pm on Apr 20, 2004 (gmt 0)

If my server defaults to process index.php first and I state in a robots.txt file to not process index.php but allow index.html and all pages linked to it, would this be a good (enough) strategy for allowing regular visitors to run the frames based website at index.php and force all SE to see only the index.html website? You know what I mean. Thanks for all your input. I suspect that's better than using the NOFRAMES tag in index.php, eh?

Also, do I have to explicately state in robots.txt not to go to each of the .php files or will the fact that they are never linked to from index.html cover me?



 11:28 pm on Apr 20, 2004 (gmt 0)

Hmmm, if I think this through I realize that the search engines will DISPLAY what they spider and therefore they would not link to the index.php page, so that does not sound like the solution. That points back to the NOFRAMES section.

Any other ideas?

Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved