Welcome to WebmasterWorld Guest from

Message Too Old, No Replies

Allowing googlebot to access certain pages



6:44 pm on Jan 23, 2009 (gmt 0)

10+ Year Member

Is there a way to keep googlebot from accessing only certain pages on a site. I am trying to let google index some of my site but not others. Actually I would only like it to index about 10% of it.


10:43 pm on Jan 23, 2009 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

If you want to stop access, use a robots.txt file with specific rules to control access - you can use either Disallow rules or Allow rules, which Google also honors.



Featured Threads

Hot Threads This Week

Hot Threads This Month