lucy24 - 4:09 am on Mar 29, 2012 (gmt 0)
It doesn't obey robots.txt in that it ignores the crawl-delay directive.
Does anyone follow "crawl-delay"? I'd got a vague idea it was one of those g### proprietary things, but obviously I was mistaken since they themselves say they ignore it.
And whatever happened to Pfui? She's not still going mano a mano with her server is she? :(
So far anything I've tried in my .htaccess file doesn't seem to work.
Can you be more specific about what you've tried and in what way it doesn't work?