Forum Moderators: open
217.237.*.* - - [06/Oct/2005:02:17:55 +0200] "GET /foo/ HTTP/1.1" 403 - "http://www.faked_referer" "yacy (x86 Windows XP 5.1; java 1.5.0_04; Europe/de) yacy.net"In fact it is not a crawler, but a "caching proxy" contributing to build some partial index from pages visited by the user. The project has been recently mentioned in heise.de's news system in a promoting manner.
It is though, gently speaking, very uncommon for such a proxy software to send a faked referer and a User-agent that is not a) the client's real User-agent or b) Mozilla/3.01 (compatible;) / Mozilla/4.0 (compatible;)
as other proxy software does.
Although a real user is behind such a request, I will continue blocking it until yacy's programmer has modified his toy accordingly.
Best,
jan
[edited by: volatilegx at 2:06 am (utc) on Oct. 10, 2005]
[edit reason] examplified referrer [/edit]
