Page is a not externally linkable
the_nerd - 6:48 am on Jun 28, 2006 (gmt 0)
User-agent: Teoma , added it to my robots.txt (months ago), but they still read my website. I really like the SE, but 0.006% of traffic sent from ask IMO doesn't justify them using my bandwidth over and over again. I traced the spider-IP address and it traces back to some ask-address. Any idea - apart from IP-Blocking and the other things meant for the bad boys?
on ask.com faq I found this:
Disallow: /