mack - 6:44 am on Sep 2, 2003 (gmt 0)

Surely Google have the ability to control what their own bot indexes on their own site withot having to specify in robots.txt?

I would think the bot has this info programed in?

Mack.