Welcome to WebmasterWorld Guest from 54.211.136.250

Message Too Old, No Replies

Allowing googlebot to access certain pages

   
6:44 pm on Jan 23, 2009 (gmt 0)

10+ Year Member



Is there a way to keep googlebot from accessing only certain pages on a site. I am trying to let google index some of my site but not others. Actually I would only like it to index about 10% of it.
10:43 pm on Jan 23, 2009 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



If you want to stop access, use a robots.txt file with specific rules to control access - you can use either Disallow rules or Allow rules, which Google also honors.

[google.com...]