Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: open
I thought that was genious idea.. Doesn't something like that already exist in RFC?
Because of their competitive status, I guess the Search Engine companies don't want to discuss these issues and come up with a new "Standard". That's regrettable.
I'm really glad they didn't do that in 13 seconds. At least if they will keep sending my 10 - 20 visitors per day...
This is the specification method in robots.txt (for a 10 second delay between requests):
Search Product Manager, Ask Jeeves