homepage Welcome to WebmasterWorld Guest from 54.161.192.130
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
Disallow index.html file
adverse effects?
yowza

10+ Year Member



 
Msg#: 546 posted 7:26 pm on Feb 9, 2005 (gmt 0)

My home page can currently be accessed as www.example.com/ or www.example.com/index.jsp.

I would like to block index.jsp in my robots.txt file. This won't have any adverse effects, will it? Being the home page, I was kind of worried about disallowing it.

The reason for blocking access is that index.jsp often has a query string attached to it, and I don't want any pages with query strings to be indexed. Alternate navigation is provided without query strings and I believe it is causing a dupe content penalty.

 

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved