Forum Moderators: open

Message Too Old, No Replies

Unnamed spider on 67.15.184.*

Very rapid crawling, hundreds of requests / minute

         

andye

5:37 pm on Mar 8, 2006 (gmt 0)

10+ Year Member



Hi all,

Subject says it, really.

It's clearly automated, it didn't bother fetching robots.txt.

The IP block belongs to opticaljungle.com, I've just dropped them a line...

One to watch out for, maybe.

best, a.

wilderness

7:44 pm on Mar 8, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Do yourself a favor and deny the backbone range.

Go to ARIN and copy the following without quotes:

" > 67.15."

andye

11:45 am on Mar 9, 2006 (gmt 0)

10+ Year Member



Hi wilderness,

I think I'm missing your point: when I look it up, I see a commercial ISP based in Texas.

They're claiming 300,000 users including dial-up, so I'd be hesitant to block out that many potential customers (of us and our clients).

Am I missing the point here somehow?

Best, a.

wilderness

2:44 pm on Mar 9, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Just expect to see more stray and unidentifed bots from that range outside of the Class C that you provided.

thetrasher

3:17 pm on Mar 9, 2006 (gmt 0)

10+ Year Member



This IP doesn't belong to a dialup. If I put the holder's main URL into G, I read "cheap web hosting".

67.15.184.0 - 67.15.184.255 = web hosting

roycerus

3:24 pm on Mar 9, 2006 (gmt 0)

10+ Year Member



Use this: [webmasterworld.com...]