Forum Moderators: open
They have a robot info page [szukacz.pl] but don't ask me to translate!
<added> Yes, it checked robots.txt and obeyed it. </added>
info:
[szukacz.pl...]
I have had this one before... and, if I remember right, the creator has posted on this board about the spider.
I have found it to be well mannered, and have not yet seen amy need to block it.
193.218.115.254 - - [25/Oct/2002:20:31:47 -0600] "GET /robots.txt HTTP/1.0" 200 4058 "-" "Szukacz/1.5 (robot; www.szukacz.pl/jakdzialarobot.html; info@szukacz.pl)"
Hit 4 other pages...
dave