WebRACE/1.1 - Crawler, Spider, and User Agent ID forum at WebmasterWorld - WebmasterWorld

Forum Moderators: open

Message Too Old, No Replies

WebRACE/1.1

(University of Cyprus, Distributed Crawler)

jdMorgan

5:56 pm on Aug 5, 2003 (gmt 0)

WebmasterWorld Senior Member

10+ Year Member

194.42.16.182 - - [05/Aug/2003:11:36:17 -0400] "GET / HTTP/1.0" 403 576 "www.mydomain.org" "WebRACE/1.1 (University of Cyprus, Distributed Crawler)"

Did not fetch robots.txt

Jim

wkitty42

6:20 pm on Aug 5, 2003 (gmt 0)

10+ Year Member

eeewww... another distributed crawler... is the webworld going to turn into a whole gaggle of grub-like bots? :)