Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Strange Inktomi Corporation IP


dstiles - 8:19 pm on May 9, 2012 (gmt 0)


I have the range 74.6.13.87 - 74.6.13.151 listed as a yahoo bot range. It's hit a few dozen times on the server this month but with a non-slurp IP (as noted in the OP) so it's been rejected.

I have a lot of slurp bot ranges listed at 74.6/16 but the rest is "allowed". Does anyone have a real reason to block the rest of the /16 or is part of it sometimes used by humans?

Same as above for 72.30/16 and 98.137/16, much of which is banned, but the "parent" range 98.136.0.0 - 98.139.255.255 is "allowed".

My current annoyance is 98.139.241.224 - 98.139.241.252 which is used by yahoomobile. I get loads of bad hits on those Ips, plus a few that may be valid. Anyone have anything on those?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4449866.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com