homepage Welcome to WebmasterWorld Guest from 54.166.10.100
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
Forum Library, Charter, Moderators: goodroi

Sitemaps, Meta Data, and robots.txt Forum

    
How to Exclude from Yahoo/MSN results!
I want to exclude underconstruction site
fm101




msg:1528417
 1:25 am on Nov 21, 2004 (gmt 0)

I want to know fastest way to exclude under-construction site from yahoo and MSN results (google haven't index it yet), at start I haven't put robots.txt and yahoo/msn indexed it and it have #1-#3 positions for targeted keywords and start getting traffic, but I don't want to show my site till its fully developed.
does
User-agent: *
Disallow: /

will work fine to exclude it from yahoo/msn results?

thanks for your help.

 

submitx




msg:1528418
 1:49 am on Nov 21, 2004 (gmt 0)

If your site is already included and you use robots.txt, it will take a while before it is removed. You will have to wait until the spider it again, which may take 1-4 weeks or more. However, you can also use a javascript to detect the referal and then redirect the visitors somewhere else, but that doesn't solve the problem I guess.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Search Engines / Sitemaps, Meta Data, and robots.txt
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved