theBear, I know, I know, it's unreasonable to expect software to work, that's a given.
But you'd think, somewhere, deep in the heart of yahoo, there might be one lonely programmer who could manage to execute something like:
if ( $link contains nofollow )
do not index or follow
I know it's unreasonable to expect this, absurd almost, but it's been years now since slurp routinely accesses pages blocked in robots.txt at least once or twice before giving up, and of course it never succeeded in not following nofollow stuff.
Maybe the yahoo guys haven't been able to get any decent programmers now that google has been slurping them all up?
I can see having a buggy algo, but not being able to parse and obey a simple little line of text in a link? yahoo must really not care about its search division.
Or it's just too hard to implement it. Oh wait, I'd better patent my algo above before somebody tries to steal it.