Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- WBSearchBot


lucy24 - 9:49 pm on Jan 26, 2012 (gmt 0)


Huh. I just recently met that name for the first time, but mine's from 91.205.96.19 (UK, I think, though I've seen a couple ranges recently that seem unsure what country they belong to).

Must have been tired when it visited me. Just robots.txt and then the front page-- or rather, not the front page. Asked for the without-www version after getting robots.txt on the correct with-www side, got an automatic 301 and then never bothered coming back. ::shrug::


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4410502.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com