- - Search Engines
- -- Search Engine Spider and User Agent Identification
- ---- Baidu's IPs - Which Are Legit?
tangor - 2:00 pm on Jul 16, 2012 (gmt 0)
I deny the Chinese version, otherwise, Baidu has (so far) honored robots.txt, taking that, (some ips more aggressive than others) but that's all they take.
Thread source: http://www.webmasterworld.com/search_engine_spiders/4475767.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com