Forum Moderators: open

Message Too Old, No Replies

CazoodleBot

formerly nutch

         

keyplyr

9:19 am on Mar 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Was: CazoodleBot/Nutch-0.9-dev (CazoodleBot Crawler)

Now: CazoodleBot/0.1 (CazoodleBot Crawler; [cazoodle.com;...] mqbot@cazoodle.com)

Requested robots.txt and one other page.

Came from 220.130.191.### Chunghwa Telecom Co.,Taipei, Taiwan

site says: Coming soon!

wilderness

10:35 pm on Mar 12, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



anyting that contains "Nutch" eats 403's from many.

Mokita

12:21 am on Mar 13, 2007 (gmt 0)

10+ Year Member



CazoodleBot eats 403s on all our sites, not only when the UA contains Nutch, but because they come from a Taiwanese IP. I have large swathes of Asian IPs blocked, because none of our sites sell to Asia, and our info sites would be of little or no interest to them. The only visitors from there are bots that are either up to no good or of zero value to us.

[edited by: Mokita at 12:22 am (utc) on Mar. 13, 2007]

wilderness

1:30 am on Mar 13, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I have large swathes of Asian IPs blocked, because none of our sites sell to Asia, and our info sites would be of little or no interest to them. The only visitors from there are bots that are either up to no good or of zero value to us.

Your dirty bugger.
What a terrible critera ;)

Mokita

1:40 am on Mar 13, 2007 (gmt 0)

10+ Year Member



LOL! :D

And you, of course, allow the whole world access to your site! ;)

wilderness

2:15 am on Mar 13, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Mokita,
I do allow in most Aussies and Kiwi's ;)

and some exception should be noted for that act of
compassion ;)

Don

Mokita

2:28 am on Mar 13, 2007 (gmt 0)

10+ Year Member



I never doubted for a moment that you are the very soul of generosity and compassion. ;)

GaryK

1:57 pm on Mar 13, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I'm feeling nauseous. I think it's the smell of BS in the air that's causing it. :)

keyplyr

3:32 am on Mar 20, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



cazoodlebot was coming from the University of Illinois last year.

[webmasterworld.com...]

GaryK

5:21 am on Mar 20, 2007 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



cazoodlebot was coming from the University of Illinois last year.

Lots of other crap was coming from them too. Last year was when I added the university to my IP blacklist.

CazoodleBot visited me with the newest UA last week. Also from Chunghwa Telecom Co.,Ltd. It didn't get far. Most everything from HINET-NET gets analyzed and then banned. So all they got was my robots.txt file and then they were shown the door.