Colocation

66.114.67.120

[wilderness]

66.114.67.120 - - [14/Sep/2003:20:48:53 -0700] "GET mypages.html HTTP/1.1" 200 9984 "-" "Mozilla/4.0 (compatible; MSIE 5.5; Windows NT 4.0)"

grabbed at least 200 pages in some 3 and half minutes.
No robots. No images.
Generated plenty of 400 errors by using gathered relative URL's.

Although this IP offers a standard ISP service, it also offeres colocation.
I've denied the entire IP range for future access.

RewriteCond %{REMOTE_ADDR} ^66\.114\.(6[4-9]¦[78][0-9]¦9[0-5])\. [OR]

[coyote]

Interesting. I found this IP in my bot trap today: 64.94.199.9 which is also from a company that offers colocation (they appear to own only 64.94.199).
Haven't checked my logs yet to see what else it grabbed.

coyote

[jdMorgan]

wilderness,

I got that exact same IP today. It blundered right into a trap.

Jim

[wilderness]

It has been my practice NOT to present the UA's of logspammers, which generally includes their name. Providing that info here IMO, only furthers their goal.

This particular visit, took some poking around to determine their actual domain (s.)
They have multiple motives, in that they offer colocation and web content filtering.

Their visit one of my sites was just the main entry page.
However, on my large site: SOMEBODY was poking around manually. It was not a spidering software. A few pages were attempted that exist in other folders although they do not exist in the folder they were being attempted, and NEVER have.
As a result I've denied:
SetEnvIf User-Agent ^Cerberian keep_out
RewriteCond %{REMOTE_ADDR} ^65\.245\.1(2[89]¦3[01])\. [OR]

65.245.128.82 - - [19/Sep/2003:18:26:41 -0700] "GET / HTTP/1.1" 200 8229 "-" "CerberianDrtrs/Version-3.0-Release-21"

[pendanticist]

Hey folks,

<aside>

Could you fill the ignorant in on what colocation is and why it could be a problem?

</aside>

Pendanticist.

[wilderness]

Pendanticist
cloaction is a rack service in which a server is mounted (in most instances temporarily) at anothers facility and generally using anothers IP ranges.

Colocation would be an excellent service from a webmasters point of view if there were some requirements of identification complaince.

If I go in to day and begin spidering or publishihing?
There is no way that DNS numbers have been reccorded with ARIN, RIPE or anybody else which will inform you or I of who that IP range belongs to.

[pendanticist]

Ah, Thanks. Learn something new everyday. :)

Pendanticist.

[fiestagirl]

This appears to be the latest greatest content filtering system for employers. Apparently it blocks, monitors, rates urls in real time (which is what we may be seeing here), and reports every move the employee makes... Search for cerberian.