Welcome to WebmasterWorld Guest from 54.145.53.251

Message Too Old, No Replies

Allowing googlebot to access certain pages

     
6:44 pm on Jan 23, 2009 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 16, 2005
posts:379
votes: 0


Is there a way to keep googlebot from accessing only certain pages on a site. I am trying to let google index some of my site but not others. Actually I would only like it to index about 10% of it.
10:43 pm on Jan 23, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


If you want to stop access, use a robots.txt file with specific rules to control access - you can use either Disallow rules or Allow rules, which Google also honors.

[google.com...]