Page is a not externally linkable
goodroi - 4:35 pm on Nov 16, 2006 (gmt 0)
a safe thing to do is to validate your robots.txt. google webmaster central has a tool which will tell you how each google bot will respond to your robots.txt
yesterday at pubcon i was sitting with some people from google webmaster central in the site crawlability session and i found out there are some slight differences, if my memory is working correctly i think the way yahoo and google handle the? is not identical