Forum Moderators: open

Message Too Old, No Replies

pipeLiner/0.3a

pipeline-search.com

         

pendanticist

11:05 pm on Nov 8, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



24.106.39.250 - - [08/Nov/2004:00:26:42 -0800] "GET /robots.txt HTTP/1.0" 200 1705 "-" "pipeLiner/0.3a (PipeLine Spider; [pipeline-search.com...] webmaster'at'pipeline-search.com)"
24.106.39.250 - - [08/Nov/2004:00:26:42 -0800] "GET / HTTP/1.0" 403 480 "-" "pipeLiner/0.3a (PipeLine Spider; [pipeline-search.com...] webmaster'at'pipeline-search.com)"

<aside>
I'm thinking an invalid UA string caused the 403.
</aside>

bull

7:53 am on Nov 11, 2004 (gmt 0)

10+ Year Member



It didn't bother with robots.txt here and was autoblocked by a anti-lowercase script.

wilderness

3:01 am on Nov 12, 2004 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



Same IP range for me.
It took me a few minutes to determine what caused the 403 to my sites.

I have a SetEnv that if contains "Spider".

cybertime

5:09 pm on Nov 16, 2004 (gmt 0)

10+ Year Member



It did not obey the robots text and got caught in my trap:

24.106.39.250[16/Nov/2004:10:15:14GET /robots.txt HTTP/1.0200-pipeLiner/0.3a (PipeLine Spider; [pipeline-search.com...] webmaster@pipeline-search.com)
24.106.39.250[16/Nov/2004:10:15:15GET /cgi-bin/trap.pl HTTP/1.0200-pipeLiner/0.3a (PipeLine Spider; [pipeline-search.com...] webmaster@pipeline-search.com)