Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- LLF user agent


Ken_S - 6:32 pm on Jan 18, 2013 (gmt 0)


New UA for me ..

* Inktomi Corporation
72.30.0.0/16 = 72.30.0.0 - 72.30.255.255

72.30.142.xxx resolved to llf531078.crawl.yahoo.net

72.30.142.xxx - - [18/Jan/2013:08:19:49 -0800] "GET /robots.txt HTTP/1.0" 200 403 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; ht tp://help.example.com/help/us/ysearch/slurp)"
72.30.142.xxx - - [18/Jan/2013:08:19:50 -0800] "GET / HTTP/1.0" 200 6058 "-" "LLF"
72.30.142.xxx - - [18/Jan/2013:08:32:46 -0800] "GET /xxxx.html HTTP/1.0" 404 3704 "-" "LLF"
72.30.142.xxx - - [18/Jan/2013:08:41:43 -0800] "GET /contact.png HTTP/1.0" 403 3592 "-" "LLF"


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4537197.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com