Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Munax bots cloaking themselves and causing high server load

Megaclinium - 8:40 pm on Apr 7, 2008 (gmt 0)


eek! I just UN-banned them afer a few months.
I had re-extracted weblogs for just their IPs and shows it DID grab the robots.txt which I hadn't thought it did, when I summed stats from a combined months file.

I do see them as referrer occasionally in traffic. I didn't really check whether it obeyed robots.txt.

Thread source:: http://www.webmasterworld.com/search_engine_spiders/3616493.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com