Forum Moderators: open
156.56.103.16 - - [17/Apr/2006:22:24:29 -0500] "GET /robots.txt HTTP/1.1" 206 4646 "-" "csci_b659/0.13"
156.56.103.16 - - [17/Apr/2006:22:24:29 -0500] "GET /foo/ HTTP/1.1" 403 - "-" "csci_b659/0.13" IP from Indiana University. Fetches ODP-listed directories, reads robots.txt, but which user-angent shall we list there?