experienced - 11:02 am on May 23, 2011 (gmt 0)

i have just checked my access log and i can see there bad bots are coming with al different range of IP, plus the same bot like gecko is using almost 100 IP address to crawl all images and pages like everyday and all.

what should i use to do. I have tried blocking the IP but now they have new range.

can we also specify through log, if this is a bot or a user.

i simply want to allow some of the top engines and there Ip address in htaccess and rest of others go away..

Pls suggest.