- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- msnbot/2 snapshots?
keyplyr - 7:27 pm on Sep 19, 2009 (gmt 0)
|I see it crawling but didn't see any images being downloaded. |
I didn't see images downloaded in this crawl. But the total size of the second request would equal page plus images, so I am assuming these are snapshots.
|...I block all images from being downloaded |
LOL, really? Then what's the point of having images?
I block image downloads from remote servers and other off-site referrers (w/ some exceptions)
Thread source: http://www.webmasterworld.com/search_engine_spiders/3992111.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com