Does it ask for robots.txt? It would make me laugh to add an entry saying User-agent: $agentname Disallow: /
I wonder if a robots.txt line like that would confuse other spiders? Perhaps safer to just ban it by IP?
Air
10:40 pm on May 21, 2001 (gmt 0)
That's funny LM, I wonder what the name intended for it really was, or did they mess up and use two $$ signs on their scalar assignment and ended up naming the scalar instead of assigning a value --> probably not important why I guess ...
