Forum Moderators: open
Just got hit by Mozzilla/3.0, and it doers NOT read robots.txt.
Note the two "zz"'s
Might be a Japanese search engine, I do not know for sure. Couple hundred hits in 3 seconds, until it fell into my Spider Trap! That cut it off!
Should be blockable just by UA Mozzilla, or IP of 218.45.232.200
Here is a log entry:
218.45.232.200 - - [07/Sep/2002:01:49:51 -0600] "GET /xx/more5.html HTTP/1.0" 200 42666 "-" "Mozzilla/3.0"
218.45.232.200 - - [07/Sep/2002:01:49:51 -0600] "GET /xx/more4.html HTTP/1.0" 200 44041 "-" "Mozzilla/3.0"
218.45.232.200 - - [07/Sep/2002:01:49:51 -0600] "GET /xx/more3.html HTTP/1.0" 200 42617 "-" "Mozzilla/3.0"
Just a heads up for ya'll!
dave