Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt vs Nofollow.

4:43 pm on Sep 7, 2010 (gmt 0)

New User

5+ Year Member

joined:Sept 7, 2010
votes: 0

Which is the best to use for large sections of site that have low quality pages?

Will eventually build these pages out but in the meantime want to block them from consuming valuable pagerank and being indexed. Some of these sections of the site have close to 100k pages. Don't want to trip any alarms while doing this either.
12:57 am on Sept 8, 2010 (gmt 0)


WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
votes: 115

welcome to WebmasterWorld [webmasterworld.com], slasher20!

in your situation i would generally suggest meta robots noindex.
otherwise the urls may be indexed even though the pages are excluded by robots.txt, in which case the SE may choose something outside of your control to show for a snippet.
12:53 am on Sept 10, 2010 (gmt 0)

New User

5+ Year Member

joined:Sept 7, 2010
votes: 0

noindex, nofollow or noindex,follow? keeping in mind within the next 6-12 months we'll be building these pages out and will then want them indexed.

is it helpful to also add these to robots.txt?

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members