4.38.68.69 unknown crawler

[Orange_XL]

I found a spider from IP 4.38.68.69 crawling my site. It does not have a user-agent string or any referrer.

It also seems incapable of properly following links, since it tried to spider my site in the /cgi-bin/, after following a action-link in a form which points to the /cgi-bin/. It does not spider graphics.

It does not obey robots.txt nor robots-metatags. It request a page every one or two seconds.

Anyone else seen this one around?

[littleman]

The IP is leased by genuity.net
Interesting enough Genuity has a traceroute tool.

Here is the results from their own t-route tool
[netperformance.genuity.com...]

gentrcrte to 4.38.68.69 (4.38.68.69), 20 hops max, 40 byte packets
1 vlan1.camcolo-isw01-rc1.bbnplanet.net (199.94.217.7) 0.662 ms
2 gigabitethernet4-0.camcolo-dbe1.bbnplanet.net (128.11.194.65) 0.913 ms
3 p4-1.cambridge1-nbr1.bbnplanet.net (4.0.2.17) 0.563 ms
4 p5-0.cambridge1-nbr2.bbnplanet.net (4.0.1.110) 0.269 ms
5 so-4-2-0.bstnma1-nbr2.bbnplanet.net (4.0.2.249) 0.733 ms
6 p9-0.nycmny1-nbr2.bbnplanet.net (4.24.6.50) 6.849 ms
7 p9-0.phlapa1-br1.bbnplanet.net (4.24.10.177) 8.821 ms
8 p15-0.phlapa1-br2.bbnplanet.net (4.24.10.90) 8.814 ms
9 so-0-0-0.washdc3-nbr2.bbnplanet.net (4.24.10.185) 11.356 ms
10 so-7-0-0.washdc3-nbr1.bbnplanet.net (4.24.10.29) 12.152 ms
11 p2-0.washdc3-cr11.bbnplanet.net (4.24.10.22) 11.710 ms
12 h0.isei2.bbnplanet.net (4.24.239.94) 19.499 ms
13 *
14 *
15 *
16 *
17 *
18 *
19 *
20 *

What ever it is, it is off line right now.

[jdMorgan]

I had that exact IP on Mon Nov 25 05:57:46 2002 (EST). I didn't see it in action, but it hit a robots.txt trap and auto-banned itself right away.

Jim