Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- msnbot/2 snapshots?


incrediBILL - 2:54 pm on Sep 19, 2009 (gmt 0)


I see it crawling but didn't see any images being downloaded.

Probably because I block all images from being downloaded ;)

Actually, they could be combining the actions of the normal crawler and the image crawler but if you're seeing back-to-back download a page then download the page again with all the images it sounds like possible screen shots.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3992111.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com