Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Server Farms, Elron Technologies and more

wilderness - 6:31 am on Dec 21, 2012 (gmt 0)


199.19.110.149 - - [21/Dec/2012:01:08:42 +0000] "GET /MyFolder/MySub/MyPage.html HTTP/1.0" 200 37093 "http://www.example.com/SameFolder/SameSub/SamePage.html" "Mozilla/5.0 (Windows NT 6.0; rv:9.0.1) Gecko/20100101 Firefox/9.0.1"

No robots, no supporting files/

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4456467.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com