Forum Moderators: open

Message Too Old, No Replies

Research Crawler

appears to be ok

         

coyote

5:41 am on Oct 11, 2003 (gmt 0)

10+ Year Member



I got crawled by "Computer_and_Automation_Research_Institute_Crawler spider@spider.ilab.sztaki.hu" today. Didn't DL very many pages and spent a few hours doing it. IP 195.111.1.2 resolves to a Hungarian Academy, so it appears legit to me.

wilderness

9:58 am on Oct 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



coyote,
this was covered here some time ago, Sorry I don't recall the details.
I have this along with much of RIPE denied.
I'm even beginng to work on referral denies from RIPE.

AGAIN, my webmaster decisions are not appropiate for every website. Instead they are based on a very narrow market traffic.

BlueSky

11:23 pm on Oct 13, 2003 (gmt 0)

10+ Year Member



This guy just visited me about two hours ago. He got caught in my .htaccess rewrite rules since I banned the word research in UAs. Even though he got a 403 on robots.txt, he still requested the homepage. After getting a 403 for that, he then requested my most popular page which gave another 403 and then left.

Peeress

4:04 am on Oct 14, 2003 (gmt 0)

10+ Year Member



(re-posting this in the proper place as I obviously overlooked this topic - thanks for pointing it out Coyote)

I saw this bot at my site before, but no reason to ban it, but it came back and got caught in my trap, so it's banned now.

Date: Mon, 13 Oct 2003 00:48:48
The ip address ^195\.111\.1\.2$ has been banned on Mon Oct 13 00:48:48 2003
The associated user agent was Computer_and_Automation_Research_Institute_Crawler spider@spider.ilab.sztaki.hu

BlueSky

7:47 pm on Oct 20, 2003 (gmt 0)

10+ Year Member



Check this out...this little guy changed his email address. Has someone been spamming him? lolol

195.111.1.93 - - [20/Oct/2003:14:36:42 -0500] "GET /robots.txt HTTP/1.0" 403 280 "-" "Computer_and_Automation_Research_Institute_Crawler (nospamspidernospam@spider.ilab.sztakinospam.hunospam)"

Peeress

7:38 pm on Oct 22, 2003 (gmt 0)

10+ Year Member



this little guy changed his email address. Has someone been spamming him? lolol

Could be!
Or maybe they're just trying to get people to trust them, if 'they' don't like spam, then they must be okay!