Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , subscribe , help , library , announcements , recent posts , open posts Subscribe and Support WebmasterWorld
Defense contractor can't set User_Agent littleman msg:407282 9:45 pm on May 21, 2001 (gmt 0) ip -> 22.214.171.124 Host name -> athens.psrw.com U_A -> $agentname ;)
This is their very rude product.
[ ...] psrw.com
mivox msg:407283 9:49 pm on May 21, 2001 (gmt 0)
Does it ask for robots.txt? It would make me laugh to add an entry saying User-agent: $agentname Disallow: /
I wonder if a robots.txt line like that would confuse other spiders? Perhaps safer to just ban it by IP?
Air msg:407284 10:40 pm on May 21, 2001 (gmt 0)
That's funny LM, I wonder what the name intended for it really was, or did they mess up and use two $$ signs on their scalar assignment and ended up naming the scalar instead of assigning a value --> probably not important why I guess ...