BeijingCrawler from -- Massachusetts (64.95.76.33); ignores robots.txt

IP = Teragram Corp. Ran TeragramCrawler last month.

[Pfui]

UA: BeijingCrawler
HOST: 64.95.76.33

LOG:

This Month (partial listing) --
64.95.76.33 - - [15/Jun/2006:01:13:18 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:01:36:51 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:02:37:57 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:03:01:01 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:19:36:34 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:20:01:07 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:21:29:12 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:21:53:14 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:22:46:43 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:23:34:51 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"
64.95.76.33 - - [15/Jun/2006:23:59:28 -0700] "GET / HTTP/1.0" 403 803 "-" "BeijingCrawler"

Last Month (all) --
64.95.76.33 - - [16/May/2006:09:13:41 -0700] "GET /robots.txt HTTP/1.0" [...] "TeragramCrawler"
64.95.76.33 - - [16/May/2006:09:13:42 -0700] "GET / HTTP/1.0" [...] "TeragramCrawler"

NOTES:

From dnsstuff.com (excerpted):

IP address: 64.95.76.33
Reverse DNS: [No reverse DNS entry per ns1.bsn.pnap.net.]
Reverse DNS authenticity: [Unknown]

NetRange: 64.95.76.32 - 64.95.76.63
CIDR: 64.95.76.32/27
CustName: Teragram Corporation [teragram.com]
City: Cambridge
StateProv: MA

FYI re TeragramCrawler [webmasterworld.com]
Corp. says AltaVista's a customer. TC may be translation-related [psychedelix.com] (tho' why, I don't know; babelfish.altavista.com [babelfish.altavista.com] is on-demand). Regardless, BC's a pest.

IMHO:

Thumb's down. IP using multiple bots; BeijingCrawler relentless.

[wilderness]

A
The backone provider range is Internap.

You'll save yourself numerous pests if you deny the two Class B ranges.

Don

[incrediBILL]

I've seen 2 instances of this name, maybe the same, maybe not.

211.100.27.169 "BeijingCrawler"
Which is actually from China...

64.95.76.33 "BeijingCrawler"
Teragram Corporation INAP-BSN-TERAGRAM-4837 (NET-64-95-76-32-1)
64.95.76.32 - 64.95.76.63

Maybe the "TeragramCrawler" changed names to blame someone else?

No clue, but part of their product offering is "TERAGRAM SEARCH AND INDEXING", linguistics and a bunch of other stuff, so who knows what they're doing.

[GaryK]

UA: BeijingCrawler
IP: 64.95.76.33

It paid my sites a visit last week. In my case it didn't just ignore robots.txt, it never even requested robots.txt.