Ask Jeeves fetched "robots.txt" on Jun, 16th and then fetched some pages on Jun, 28th. Is this really considered reasonable? I would expect them to get the "robots.txt" on the same day they actually crawl the page.
There are some (stupid) robots that get robots.txt, page, robots.txt, next page, ... I don't like that either but 12 days? Can anyone confirm?