helenp - 10:04 am on Jan 22, 2012 (gmt 0)

It's definitely not what my host does, and they've got something like four trillion hosted domains.Very very rarely a visitor gets hit with a 503 if it is an IP belonging to a known evil robot. They've also got something in their config file that looks for certain patterns. Are you sure you have the best possible host? :)

I suppose you mean you get a 403 not a 503.

Well i have been pleased with the host until now as before I had many problems with greylisting emails coming back and when he bought they host and migrated to new server the greylisting problem disappeared. However every time there were a bug that was not easily demostrated there fault, I have to argue and he keeps telling me to hire a programmer....bad manners, but finally the things got fixed.

Anyway he does not seem sure about the 406 as last night he said diferent things, and all of them I checked, only 1 day looks like bots, but the true is there are more bots than human.
I have added a crawl-delay: 10 to see if becomes better as the one I posted before says it do respect the crawl-delay, but as I said, I didnt have any number that high before.
And what is bothering me also is the chat that do take resources, but not that much.
So I suppose if not changed in a coupple of days I better look for a new host.
I know you cant recomend here, but I need a good and cheap as we are not a heavy traffic site.
Thanks for your help.