tedster
msg:3672399 | 7:06 pm on Jun 11, 2008 (gmt 0) |
Use a robots.txt file in the root folder of your test domain - with one rule: User-agent: *
Disallow: / That will keep ALL well-behaved spiders out so you won't get indexed. After a short period, any urls that were indexed should also be dropped.
|
Ferro9
msg:3672403 | 7:17 pm on Jun 11, 2008 (gmt 0) |
Use .htaccess to set a password.
|
tedster
msg:3672411 | 7:23 pm on Jun 11, 2008 (gmt 0) |
Yes, Ferro9 has a good idea - do that, too. It will also keep out the bad bots and scrapers.
|
g1smd
msg:3672574 | 11:57 pm on Jun 11, 2008 (gmt 0) |
The robots.txt file stops spidering by well behaved robots, but does not disallow the URL for the resource from appearing in the SERPs. It also does not guard against a scraper stealing all your content before your real site goes live. I usually disallow in .htaccess/.htpasswd. That stops everyone who does not know the password.
|
jaimes
msg:3672596 | 12:33 am on Jun 12, 2008 (gmt 0) |
Thanks
|
|
