Welcome to WebmasterWorld Guest from 220.127.116.11
Google has been caught testing a major new layout to their search results – full page previews of the target site and pale blue backgrounds behind the search results when you hover over them.
One of the fascinating things about this is that they are highlighting certain sections of the page in orange and expanding the text to provide a snippet of information. This shows that they have the technology to know exactly where a piece of text is on every single web page. The snippets highlighted are not always the same as the snippet in the search results.
Another issue has to do with copyrights. And, of course, NOINDEX tags, in addition to regular access/indexing controls. (sighs)
My jury's still out on the benefits.
The screenshot on the site you cite -- [webfreelancer.net.au...] -- shows the preview is a heckuva lot larger than the average thumbnail. See the original example larger here: [blogstorm.co.uk...]
Did it read/heed robots.txt? Or did it appear to 'share' prior Googlebot robots.txt hits?
Did it hit all kinds of files, launch JS, etc.?
Did it crawl in typical a Googlebot pattern/rate?
But how to determine the UA/IP?
All have the images and pics folders disallowed in robots.txt
[edited by: Pfui at 2:43 am (utc) on Nov 19, 2010]