mrMister - 1:29 am on May 5, 2005 (gmt 0)

mrMister, the one thing I'd say is that it's only been on Labs for a few hours, so folks may want to give it a little while before judging it or deciding what they think.

That's a fair enough statement.

I have been quick to jump to conclusions on some of the bandwidth usage issues.

However, I do think that the Webmaster should be given more control over which pages can be accessed by the app, especially during beta testing.

It's just impossible for the programmers to pre-empt every possible problem that could occur on any of the billions of web pages out there.

The webmaster of the site is in a much better position to guage the possible problems that might occur on their site and therefore they should be able to have the final say on whether the caching and prefetching should go ahead or not.

There are a number of problematic issues that I now have to deal with regarding this pre-fetching on some of my sites. None of these would occur if the app obeyed my robots.txt files.