Need to Block Pesky Spider

markmonitor

[guillermo5000]

I would like to block a spider that is visiting my site. The spiders DNS is: pool-138-89-103-107.mad.east.verizon.net

A whois search reveals that this belongs to markmonitor.com. I understand that there is a method to determin a companys block of ip addresses, is this true? If so, how do I do it. Thanks.

P.S. Maybe there is another way to block this spider? It uses a common user agent (mozilla 4.0)

[wilderness]

64.124.14.0 - 64.124.14.127
RewriteCond %{REMOTE_ADDR} ^64\.124\.14\.([0-9]¦[1-5][0-9]¦[6-9][0-9]¦1[0-2][0-9])$ [OR]

Please note that I have extended the 127 range to 129 for simpliciity.

[guillermo5000]

Thank you, but that does not seem to block my spider that visited from 138.89.102.107?

[wilderness]

markmonitor.com

64.124.14.0 - 64.124.14.127
RewriteCond %{REMOTE_ADDR} ^64\.124\.14\.([0-9]¦[1-5][0-9]¦[6-9][0-9]¦1[0-2][0-9])$ [OR]

138.89.102.107 is a Verizon range

Verizon Global Networks, Inc. VZGNI-PUB-2 (NET-138-89-0-0-1)
138.89.0.0 - 138.89.255.255
Verizon Internet Services VZ-DSLDIAL-MDSNNJ-6 (NET-138-89-0-0-2)
138.89.0.0 - 138.89.191.255

deny from 138.89.
or
RewriteCond %{REMOTE_ADDR} ^138\.89\.([0-9]¦[1-5][0-9]¦[6-9][0-9]¦1[0-9][0-9])\.

Please note that I have extended the 191 range to 199 for simpliciity.
This may not hold water as most DSL's work on shared IP's and could have an entriely different range at the next logon.

[guillermo5000]

I'm confused now. Below is my whois information, Am I wrong in assuming this is Markmonitor's IP? Will I be blocking other ligitimate visiters if I block the 138.89.xx.xx ip address? Is markmonitor using a different ip than usual? Where did you get that other range of ips from? Thanks.

Bill

*******************Whois********************
Target: pool-138-89-103-107.mad.east.verizon.net
Node Net Reg IP Address Location Node Name
18 1 1 138.89.103.107 40.761N, 74.422W pool-138-89-103-107.mad.east.verizon.net

Network Data
Network id#: 1
Verizon Global Networks, Inc. VZGNI-PUB-2 (NET-138-89-0-0-1)
138.89.0.0 - 138.89.255.255
Verizon Internet Services VZ-DSLDIAL-MDSNNJ-6 (NET-138-89-0-0-2)
138.89.0.0 - 138.89.191.255

ARIN WHOIS database, last updated 2003-08-14 19:15

Whois Server Version 1.3

Domain names in the .com and .net domains can now be registered
with many different competing registrars. Go to [internic.net...]
for detailed information.

Domain Name: VERIZON.NET
Registrar: EMARKMONITOR INC. DBA MARKMONITOR
Whois Server: whois.markmonitor.com
Referral URL: [markmonitor.com...]
Name Server: NS2.BELLATLANTIC.NET
Name Server: NS1.BELLATLANTIC.NET
Status: REGISTRAR-LOCK
Updated Date: 17-apr-2003
Creation Date: 06-jul-1999
Expiration Date: 06-jul-2004

[wilderness]

Questions, questions and more questions. Oh My ;)

I'm confused now. Below is my whois information, Am I wrong in assuming this is Markmonitor's IP?

Yes you are.
Verizon is the internet provider for whomever was accessing your pages.

Will I be blocking other ligitimate visiters if I block the 138.89.xx.xx ip address?

Of course.

Is markmonitor using a different ip than usual?

I haven't a clue. You'll need to ask Mark.
Or perhaps Verizon (however I wouldn't hold your breath awaiting a response)

Where did you get that other range of ips from?

Fellow participant george has a nice tool.
try a google on canufly on
markmonitor.com

[wilderness]

Why not make life TOTALLY easier and provide a COMPLETE solitary log entry from the visit.

In the process changing any files names or URL's which might refelct your own website?

[guillermo5000]

Thank you. I'll do that.

[wilderness]

*******************Whois********************
Target: pool-138-89-103-107.mad.east.verizon.net
Node Net Reg IP Address Location Node Name
18 1 1 138.89.103.107 40.761N, 74.422W pool-138-89-103-107.mad.east.verizon.net

Network Data
Network id#: 1
Verizon Global Networks, Inc. VZGNI-PUB-2 (NET-138-89-0-0-1)
138.89.0.0 - 138.89.255.255
Verizon Internet Services VZ-DSLDIAL-MDSNNJ-6 (NET-138-89-0-0-2)
138.89.0.0 - 138.89.191.255

ARIN WHOIS database, last updated 2003-08-14 19:15

Whois Server Version 1.3

Domain names in the .com and .net domains can now be registered
with many different competing registrars. Go to [internic.net...]
for detailed information.

Domain Name: VERIZON.NET
Registrar: EMARKMONITOR INC. DBA MARKMONITOR
Whois Server: whois.markmonitor.com
Referral URL: [markmonitor.com...]
Name Server: NS2.BELLATLANTIC.NET
Name Server: NS1.BELLATLANTIC.NET
Status: REGISTRAR-LOCK
Updated Date: 17-apr-2003
Creation Date: 06-jul-1999
Expiration Date: 06-jul-2004

The ONLY relevant information (at least as related to website logs) in ANY of the above is:

Verizon Global Networks, Inc. VZGNI-PUB-2 (NET-138-89-0-0-1)
138.89.0.0 - 138.89.255.255
Verizon Internet Services VZ-DSLDIAL-MDSNNJ-6 (NET-138-89-0-0-2)
138.89.0.0 - 138.89.191.255

This provides the IP address range of the visitor accessing your site.

Now you might find another use for the other garbage.
My time however is previously consumed by enough irrelevant tasks. Many of which serve no useful purpose other to appease my entertainment.

BTW, no place in that IP range is there a mention of markmonitor.