bull - 5:26 pm on Mar 18, 2004 (gmt 0)
So because a rarely-seen spider didn't pull your particular .js files, you assume it obeys robots.txt?
1. The bot is not at all rare, see several threads in f39, too.
2. Yes, from my observations I assume it obeys robots.txt
3. You -or anyone else- need to prove the contrary. No respect for robots.txt is commonly regarded as something, let's say, unethical for robots. In dubio pro reo.