Agree. If the links are nofollow, they shouldn't harm you. Also, you need not add a link in each and every comment. Its good to be selfless and get no link in return of a comment. This will make your your commenting and link building activity look natural and not intentional.