Welcome to WebmasterWorld Guest from 18.104.22.168 , register , free tools , login , search , pro membership , help , library , announcements , recent posts , open posts Become a Pro Member
indy library stevelibby msg:4026627 4:03 pm on Nov 17, 2009 (gmt 0) every few minutes my server is getting posts from this agent. HTTP/1.0 Mozilla/3.0+(compatible;+Indy+Library) it seems to be posting half the full url which i find odd. Is there a way in which i can stop this agent hitting my server?
goodroi msg:4026983 12:32 am on Nov 18, 2009 (gmt 0)
If it is a good bot you could use robots.txt. If it ignores robots.txt then use .htaccess file.