Forum Moderators: DixonJones

Message Too Old, No Replies

Fake msnbot

hit my bot trap, got banned

         

Hetta

4:20 pm on Feb 10, 2006 (gmt 0)

10+ Year Member



It tried to pick up a thousand or so of my pages, but it got banned after a few dozen.

Here's the IP and UA (a line from my log):

63.223.69.#*$! - - [06/Feb/2006:15:07:55 -0800] "GET /page.html HTTP/1.1" 200 4080 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)"

That IP block is "Beyond The Network America, Inc.", should I block it?

Thanks.

Pfui

1:44 am on Feb 11, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I did. They hit me yesterday morning. From the same IP, running the same (apparently) spoofed msnbot. Ignored all rules. Grrrr...

Ref:

Was this a fake "msnbot"? (Non-MS IP; no robots.txt; triggered traps) [webmasterworld.com]
Does Microsoft sell/license their bot to others?