Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Allowing googlebot to access certain pages

6:44 pm on Jan 23, 2009 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 16, 2005
votes: 0

Is there a way to keep googlebot from accessing only certain pages on a site. I am trying to let google index some of my site but not others. Actually I would only like it to index about 10% of it.
10:43 pm on Jan 23, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
votes: 0

If you want to stop access, use a robots.txt file with specific rules to control access - you can use either Disallow rules or Allow rules, which Google also honors.