Page is a not externally linkable
bouncybunny - 1:29 am on Nov 7, 2006 (gmt 0)
If all we are interested is these three bots (and for many that may be the case) then using; User-agent: * should be enough now? Yes? No?
I'm trying to work out if and how this differs from Google's usage? And MSNs for that matter.