Forum Moderators: open
gamma.ucsd.edu
Mozilla/5.0 (compatible; Nmap Scripting Engine; http://nmap.org/book/nse.html)
robots.txt? NO
gamma.ucsd.edu
Mozilla/5.0 (Linux; favicon Internet survey research; bmenrigh@ucsd.edu)
robots.txt? NO
*Prior bit on blocking troublesome bots from .edu subdomains here [webmasterworld.com].
robots.txt? NO
Hit root, then ~3 minutes later, hit favicon.ico.
FWIW: I get so tired of university profs/students/employees ignoring Web standards like the Robots Exclusion Protocol [robotstxt.org] and running roughshod all over the place. Try raising the bar!
See also, courtesy of a spelling-challenged bot-runner at stanford.edu: TwitterReseach [webmasterworld.com] [sic]
However. . .if you think of these same universities as 3rd party groups funded by research grants?
I can assure (from some ten years worth of experience) that you'll view their visits in your logs quite differently.