Forum Moderators: phranque
i run a directory made up of hundreds of static hml pages, basically spider food. now some idiot has dropped by these past few days and accessed every one of my pages. the first time they used web copier so i banned the agent using .htaccess. now though they are coming in using different ip address each time and not indicating any form of agent.
if i had time and patience i'd write a dynamic logfile analyzer and look for duplicate ip addresses accessing large quantities of pages over a small time period and block them but i don't have the time or experience to do it in the little time i have free.
it isn't just the bandwidth that's annoying it's the fact that this fool is skewing my stats.
does anyone know how i can stop this?
thanks in advance
btw this is a very interesting and educational forum.
