Forum Moderators: open

Message Too Old, No Replies

tailrank

         

keyplyr

7:39 pm on Jan 29, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month




64.34.179.237 - - [29/Jan/2006:03:44:02 -0800] "GET / HTTP/1.1" 301 259 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"

They say...

TailRank is a service that monitors blogs trying to find interesting memes and hot stories... We're reading your site trying to find out how you're influencing the blogosphere. We then use this to drive the ranking system on our website...This is a good thing. If TailRank decides your story is interesting we then promote it to our site which can drive a lot of traffic your way!

This is not a good thing when they do not request, nor follow, robots.txt but keep coming back day after day causing 404s looking for non-existent files. Despite banning their UA and serving them 403 responses, they keep coming.

keyplyr

5:37 am on Feb 18, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I emailed them to stop and explained that I do not have a blog nor forum nor RSS et al. They replied that they would remove me from their list. They did not. This goes on ad infinitum:

64.34.179.237 - - [17/Feb/2006:05:40:32 -0800] "GET / HTTP/1.1" 301 259 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:32 -0800] "GET /forbidden.html HTTP/1.1" 200 191 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:32 -0800] "HEAD /atom.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:32 -0800] "HEAD /index.rss HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:33 -0800] "HEAD /rss.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:33 -0800] "HEAD /index.rdf HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:33 -0800] "HEAD /index.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:05:40:34 -0800] "HEAD /xml/rss.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:15 -0800] "GET / HTTP/1.1" 301 259 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:15 -0800] "GET /forbidden.html HTTP/1.1" 200 191 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:16 -0800] "HEAD /atom.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:16 -0800] "HEAD /index.rss HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:17 -0800] "HEAD /rss.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:17 -0800] "HEAD /index.rdf HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:18 -0800] "HEAD /index.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"
64.34.179.237 - - [17/Feb/2006:13:46:21 -0800] "HEAD /xml/rss.xml HTTP/1.1" 403 0 "-" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1; aggregator:TailRank; [tailrank.com...] Gecko/20021130"