- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- Google Web Preview
Samizdata - 10:04 pm on Nov 22, 2010 (gmt 0)
A Google employee quoted in The Register:
So much for testing the beast before unleashing it on the world.
It would also have been sensible - not to mention polite - to warn webmasters in advance that they are expected to remove their robots.txt restrictions so that their images can be used.
As for offering a "nopreview" tag, they wouldn't want to copy Bing, would they?
Thread source: http://www.webmasterworld.com/search_engine_spiders/4223018.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com