Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Allowing googlebot to access certain pages

6:44 pm on Jan 23, 2009 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 16, 2005
votes: 0

Is there a way to keep googlebot from accessing only certain pages on a site. I am trying to let google index some of my site but not others. Actually I would only like it to index about 10% of it.
10:43 pm on Jan 23, 2009 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
votes: 0

If you want to stop access, use a robots.txt file with specific rules to control access - you can use either Disallow rules or Allow rules, which Google also honors.



Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members