- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- Google Web Preview
londrum - 11:48 am on Nov 12, 2010 (gmt 0)
is there way to allow the google preview bot to spider your images in robots.txt?
i know that adsense/adwords has got it's own bot name that we can block. presumably we can do the same with this new preview thing too.
Thread source: http://www.webmasterworld.com/search_engine_spiders/4223018.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com