Is there a way to keep googlebot from accessing only certain pages on a site. I am trying to let google index some of my site but not others. Actually I would only like it to index about 10% of it.
tedster
10:43 pm on Jan 23, 2009 (gmt 0)
If you want to stop access, use a robots.txt file with specific rules to control access - you can use either Disallow rules or Allow rules, which Google also honors.