Page is a not externally linkable
GaryK - 11:27 pm on May 4, 2005 (gmt 0)
But there's no mention of what the user agent is. Has anyone here figured it out yet? I don't want to panic, yet. I just want to know more about this thing before making a decision on banning it or not.
There's a post at Search Engine Watch which states that, when Google prefetches a page, webmasters will see a Google user agent in their user logs.