Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Microsoft bot 157 ranges updated


Pfui - 12:12 am on Nov 9, 2011 (gmt 0)


Thanks, dstiles. I, too, must juggle expediency with capability (the server's; my own:) Thus when it comes to the 157s et al, things get a bit-ham-fisted: msnbot and bingbot are only okay from:

RewriteCond %{REMOTE_HOST} !\.(bing|live|msn)\.com$
RewriteCond %{REMOTE_ADDR} !^65\.(54|55)\.
RewriteCond %{REMOTE_ADDR} !^157\.55\.
RewriteCond %{REMOTE_ADDR} !^207\.46\.

(The jury's still out on 157.56.)


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4384611.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com