Welcome to WebmasterWorld Guest from

Forum Moderators: Ocean10000 & incrediBILL

Message Too Old, No Replies




6:04 am on Apr 18, 2006 (gmt 0)

10+ Year Member - - [17/Apr/2006:22:24:29 -0500] "GET /robots.txt HTTP/1.1" 206 4646 "-" "csci_b659/0.13" - - [17/Apr/2006:22:24:29 -0500] "GET /foo/ HTTP/1.1" 403 - "-" "csci_b659/0.13"

IP from Indiana University. Fetches ODP-listed directories, reads robots.txt, but which user-angent shall we list there?


1:03 am on Apr 19, 2006 (gmt 0)

WebmasterWorld Senior Member wilderness is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

but which user-agent shall we list there?

Hey Jan,
How goes it?

Your likely one of a few to appreciate the humor in my answer?

"SetEnvIf User-Agent csci keep_out"



7:07 pm on Apr 20, 2006 (gmt 0)

10+ Year Member

Hey Don,

rhetorical question ;)
As many others, this one got caught by my anti-lowercase script. Couldn't live without it ;)




Featured Threads

Hot Threads This Week

Hot Threads This Month