Welcome to WebmasterWorld Guest from 54.147.44.13

Forum Moderators: goodroi

Message Too Old, No Replies

How NOT to be seen.

What if you don't want search engines to find you?

     
11:36 pm on Apr 14, 2009 (gmt 0)

New User

10+ Year Member

joined:Feb 17, 2003
posts: 10
votes: 0


Strange question?

Is there any way to make search engines ignore your web site? I need to make up an unsecure site that's available on the web but I'd rather the search engines ignore it so we don't get a slew of freeloaders looking for that fast buck. Does anyone know if this is possible?

Thanks.
Hutch

11:58 pm on Apr 14, 2009 (gmt 0)

Moderator from US 

WebmasterWorld Administrator lifeinasia is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Dec 10, 2005
posts:5550
votes: 24


There are a number of ways:
- robots.txt
- <meta name="Robots" content="NOINDEX"> on every page
- block user agents with .htaccess

Either of the first 2 should block most well-behaved bots. The 3rd will require updates as you find more bots to block.

10:16 am on Apr 15, 2009 (gmt 0)

New User

10+ Year Member

joined:Feb 17, 2003
posts:10
votes: 0


Thanks for the help :)

Hutch

10:05 pm on May 2, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member g1smd is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:July 3, 2002
posts:18903
votes: 0


The robots.txt disallow stops bots spidering the site but will still allow URLs from your site to be listed in the SERPs. These will be listed as URL-only entries if anyone ever links to those URLs from some other place.

The meta noindex tag will prevent even the URLs from being listed in the SERPs, but bots will need to access those pages in order to actually see the meta tag.

 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members