Yahoo indexes my site not right

[designaweb]

I have a site (duh!, who in here hasn't) that has 400+ pages indexed in Yahoo. The structure of this site is like this:

www.widgets.com/dir1/
www.widgets.com/dir1/dir2/
www.widgets.com/dir1/dir2/page.html

However, in Yahoo the results are shown as:
www.widgets.com/dir1
www.widgets.com/dir1/dir2

Resulting in dead links. Now I have managed to fix this by adding a few extra lines in my .htaccess, but can anyone tell me why Yahoo does this?

[2_much]

I think that's just how their crawler is programmed. There's lots of similar problems like this. Just adjust to them..the traffic is worth it.