Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- abot/0.1


idoc - 3:26 am on Jun 2, 2005 (gmt 0)


Sounds like you have the mask aready, but in case... a /26 cidr notation corresponds to a 255.255.255.192 subnet mask.

All commercial spiders utilize your commercial resources for their commercial benefit. With the major search engines it is mostly win-win because they generate trafic in return. With many other commercial bots there is no upside. I always ban commercial bots where there is no upside without particular regard to what their commercial interests are.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/2799.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com