Staffa - 9:14 pm on Aug 18, 2011 (gmt 0)
Another 5 visits since my previous post, this time with the allow rule at the start of robots.txt but still the same result. Bingbot moves on without looking at a single page.
I have now removed the allow rule in order not to confuse the other bots on account of one illiterate one. It's open doors for everyone but Gbot so no rule is necessary.
Tangor, does that clear anything up for you, in what you are trying to find out ?
I don't mean as in finding a solution to make Bbot crawl my site, because "Frankly, my dear, I don't give ....." whether or not it does.