Forum Moderators: open
Took robots.txt and default root file then went away.
Has anyone seen this before? I see lots of log file entries, but no explanation what it does. Thanks.
202.96.51.149 - - [22/Dec/2008:16:25:33 +0100] "GET /robots.txt HTTP/1.0" 200 34 "-" "librabot/1.0 (+http://search.msn.com/msnbot.htm)"
202.96.51.150 - - [22/Dec/2008:16:25:34 +0100] "GET /some-content-site.html HTTP/1.0" 200 29712 "-" "librabot/1.0 (+http://search.msn.com/msnbot.htm)"
202.96.51.149 Resolves to China....MSN bot from China?
Traces to: CNCGROUP Beijing Province Network / Microsft (China) Co.Ltd
The one that hit my website, also from China and did not even ask for a robots.txt file....how rude!
219.142.53.17 librabot/1.0 (+http://search.msn.com/msnbot.htm)
traces to: Data Communication Division / Beijing Telecom
Now I dont know about all you guys, but I have a long history of...shall we say "undesirable traffic" that emanates from China. Until I see a consistant "user agent" and traceable IP range for this bot, its getting blocked!
[edited by: Lain_se at 3:33 am (utc) on Jan. 27, 2009]
[forums.microsoft.com...]
What I'm seeing is Brett Yount, Moderator and Program Manager, Live Search Webmaster Tools, recommends blocking an IP Address in China. Depending on your traffic that may or may not be a good idea. All he's really saying about it is blocking that IP Address will not block msnbot. :)
