Welcome to WebmasterWorld Guest from

Forum Moderators: goodroi

Message Too Old, No Replies

Robots.txt vs Nofollow.



4:43 pm on Sep 7, 2010 (gmt 0)

5+ Year Member

Which is the best to use for large sections of site that have low quality pages?

Will eventually build these pages out but in the meantime want to block them from consuming valuable pagerank and being indexed. Some of these sections of the site have close to 100k pages. Don't want to trip any alarms while doing this either.


12:57 am on Sep 8, 2010 (gmt 0)

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

welcome to WebmasterWorld [webmasterworld.com], slasher20!

in your situation i would generally suggest meta robots noindex.
otherwise the urls may be indexed even though the pages are excluded by robots.txt, in which case the SE may choose something outside of your control to show for a snippet.


12:53 am on Sep 10, 2010 (gmt 0)

5+ Year Member

noindex, nofollow or noindex,follow? keeping in mind within the next 6-12 months we'll be building these pages out and will then want them indexed.

is it helpful to also add these to robots.txt?

Featured Threads

Hot Threads This Week

Hot Threads This Month