Forum Moderators: open
2003-02-09 05:21:36 64.69.66.176 - 217.114.161.44 80 GET /index.html - 200 EasyWebPromotion1.0:+(http://www.easywebpromotion.com/bot.html)
It seemed to be very aggressive, downloading the file 10 times in 5 seconds, I want to block it but there is no information on their website about if they obey the robots.txt standard or not.
Does anyone know if using the robots.txt file will block it?
Thanks
24.71.12.65 - [zwnet.com...]
64.69.66.176 - [zwnet.com...]
24.71.12.65 - [easywebpromotion.com...]
24.71.12.65 - [123hosting.com...]
Best way to block is by .htaccess and/or keying on the agent "EasyWebPromotion".