homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Visit PubCon.com
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

proper way of changing site

 2:25 pm on Apr 30, 2004 (gmt 0)

Im removing a directory from my site. I placed the 301 moved permanently code on the old page, which is already indexed in search engines.
My question is should i excluded this directory (that has been removed and replaced with the redirect code) on my robots file, or will this exclusion cause it to never be viewed and known that it has been moved permanently?
Thanks in advance!



 5:11 pm on May 1, 2004 (gmt 0)

As you surmised, if you disallow the directory, they won't attempt to fetch that file, and therefore will never see your redirect. So leave it accessible.


Global Options:
 top home search open messages active posts  

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved