Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- facebookexternalhit - Accessing /images/ now?


brokaddr - 5:35 pm on Nov 10, 2012 (gmt 0)


I know there are a number of threads for this UA already, however, they are too old to respond to: [webmasterworld.com...]


Safe to say a lot of us are being visited by user-agent: facebookexternalhit/1.0 [facebook.com...] -- correct?

How many of these hits are simply trying to access all of your entire /images/ folder - no content specified?

A few IPs:
69.171.229.114
69.171.228.251
69.171.224.116
66.220.152.1
69.171.234.1
69.171.237.10

All visits from these varying Ips are within a few minutes of each other.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4517817.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com