Forum Moderators: DixonJones

Message Too Old, No Replies

Head - Get, Head - Get

Repeats again and again with 206s

         

pendanticist

1:04 pm on Nov 5, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



12.247.four two.20 - - [04/Nov/2003:14:41:18 -0800] 
"GET /robots.txt HTTP/1.1" [b]206[/b] 1524 "-" "Mozilla/4.7 [en] (WinNT; U)"
12.247.four two.20 - - [04/Nov/2003:14:41:18 -0800]
"HEAD / HTTP/1.1" [b]200[/b] 0 "-" "Mozilla/4.7 [en] (WinNT; U)"
12.247.four two.20 - - [04/Nov/2003:14:41:19 -0800]
"GET / HTTP/1.1" [b]200[/b] 20624 "-" "Mozilla/4.7 [en] (WinNT; U)"
12.247.four two.20 - - [04/Nov/2003:14:41:19 -0800]
"HEAD /Blah.html HTTP/1.1" [b]206[/b] 0 "-" "Mozilla/4.7 [en] (WinNT; U)"
12.247.four two.20 - - [04/Nov/2003:14:41:20 -0800]
"GET /Blah.html HTTP/1.1" [b]206[/b] 3949 "-" "Mozilla/4.7 [en] (WinNT; U)"

Very methodically went thru more than any other bot to date in that this one also attempted to harvest my files on one Vietnam Veterans memorial page I have.

  • With the exception of the first two calls all 206s, so I guess it wasn't total server drain.

  • Took a Head and Get for each file throughout.

  • Pulled over 500 files in just under four minutes.

    Thanks.

    Pendanticist.

  • BlueSky

    2:42 pm on Nov 5, 2003 (gmt 0)

    10+ Year Member



    Weird. Any idea what a 206 gives him. Would he get readable partial content or just garbage.

    pendanticist

    2:55 pm on Nov 5, 2003 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Each Head Got zero bytes across the crawl.

    Each Get Got whatever the byte values - per each and every index.

    Pendanticist.