Msg#: 3337848 posted 12:16 pm on May 12, 2007 (gmt 0)
How could alexa possibly record your site's traffic? If all you wanted to do was to prevent their bot from spidering your site (is that what you call recording your traffic?), you could have saved yourself time by adding a line to your robots.txt. ;)
Msg#: 3337848 posted 3:20 pm on May 14, 2007 (gmt 0)
It is rare but it does happen from time to time that a major robot will not properly handle the robots.txt. It appears that Alexa did handle the situation as well as possible. You complained the bot misbehaved and indexed your site. Alexa removed your site from the index and requested snippets of your log file so they could further investigate and fix the bot.
You should also double check your code. In my experience 9 out of 10 misbehaving robots are actually improper website code.
Msg#: 3337848 posted 10:45 am on May 20, 2007 (gmt 0)
I will not get into the particulars legale because you have requested that I not do so. But this is what I have done.
____ I had the my host society look at my setup. It is working. It is that 1 time from the 10 that the bot did not listen.
But with that stated... My site is still listed in their cache. And the bot has returned.
My robots.txt file is now with every possible never come to my home again command against the bot. My .htaccess file has been set to ban the alexa ip addresses, toolbar users, etc. All of my pages have been set to tell the bot to go away.