Forum Moderators: open

Message Too Old, No Replies

Bot coming from Everyones Internet

         

Mokita

11:57 am on Jun 21, 2006 (gmt 0)

10+ Year Member



IP is always - 67.15.119.**
UA is always - User-Agent: User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)
(Note the duplicated "User-Agent:")

First saw it in early March. From early April it has visited 7-8 times per month, always retrieving just the index page - no graphics etc.

I've banned the whole block of 67.15. (belonging to Everyones Internet) - even though this particular bot only ever comes from the one IP.

[edited by: volatilegx at 3:04 pm (utc) on June 21, 2006]
[edit reason] obscured IP address [/edit]

GaryK

3:42 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I saw the same thing last week only without the duplicated "User-Agent:" in the user agent.

wilderness

5:22 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



You'll see many unidentified crawls from users at Everyone's net.

GaryK

5:47 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Is this one of those hosts like HE?

wilderness

6:48 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Is this one of those hosts like HE?

Basically, yes, however I have legitimate visitors from Everyone's as well. (something quite unusual at HE.)

incrediBILL

6:53 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



It's a part hosting farm, part ISP, but I've blocked everything coming from the hosting part so if it ends in ev1servers.net it's banned.

Just curious why the IP was obscured for a server, thought that was only for human IPs?

Not challenging the rules on IPs, just want to make sure I'm clear on them is all, as that user agent is definitely not a browser.

wilderness

7:09 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just curious why the IP was obscured for a server, thought that was only for human IPs?

Bill,
It's been customary to obscure IP ranges from providers that do NOT list sub-delgations to commercial companies in this forum.
Dan's the only one that can really address this issue.

The only sub-delegations that I have stored locally from Everyone's are the 64.246. ranges.
Although I haven't spent any real time searching for more.

Don

edited:

Go to ARIN and do a sub-delegation on 67.15 in the following way and without the quotes. (leave the blank space between the operator and 67

"> 67.15."

incrediBILL

11:43 pm on Jun 21, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



If you have reverse DNS enabled in Apache, everything coming from their servers is clearly ID'd as ev1servers.net so that's been a fairly clean way to play whack-a-mole with them so far IMO.

wilderness

12:00 am on Jun 22, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



66.98.128.33 - - [11/Jun/2004:05:21:18 -0700] "GET /robots.txt HTTP/1.1" 206 2365 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0)"

67.15.80.14 - - [25/Nov/2004:10:24:30 -0800] "GET /robots.txt HTTP/1.0" 200 2891 "-" "CreativeCommons/0.06-dev (Nutch; [nutch.org...] nutch-agent@lists.sourceforge.net)"