Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- BingBot Fake
dstiles - 10:39 pm on Feb 3, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4540866.htm
I didn't subscribe to majestic's philosophy and I also decided it was easier to block all MJ bots with both robots.txt (for legit ones) and by 403 (for illegal ones). Have to say the legit ones seem to obey robots.txt.
Brought to you by WebmasterWorld: http://www.webmasterworld.com