Forum Moderators: open

Message Too Old, No Replies

InetURL:/1.0

Doesn't read robots.txt ...

         

bobothecat

7:50 pm on Oct 11, 2003 (gmt 0)



12.227.105.*** - - [11/Oct/2003:14:34:44 -0500] "GET / HTTP/1.1" 200 18249 "-" "InetURL:/1.0"

Have received a couple of hits from this 'spider/UA' for the past few days. Does not fetch robots.txt, and the IP has been different on each visit.

Have gone ahead and banned unless someone has information on why it shouldn't.

Just a heads-up.

Peter

[edited by: keyplyr at 6:10 am (utc) on Sep 22, 2018]
[edit reason] Obscured IP address per Forum Charter [/edit]

bobothecat

7:56 pm on Oct 11, 2003 (gmt 0)



Not sure why I can't edit the previous email, but just wanted to add that it (InetURL:/1.0) does not grab any images, just the web page (.html).

GaryK

7:58 pm on Oct 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I am not personally familiar with this bot. But in general if a bot does not read AND OBEY robots.txt I ban them. The decision to ban a bot is always an individual one so consider your options and make your own decision. :)

wilderness

10:48 pm on Oct 11, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



INETURL Access an Internet Server (eg. for authorization, information upload etc.). Also allows plugins to be run on remote computers via the internet.

A google provides plenty of links to download.
Information however very sparse.
It seems to be deemed a "Dynamic Link Library"