Forum Moderators: open
:: riffle through raw logs ::
Oh. Fancy that. This month--and never before--it has visited a total of three times, each time requesting only robots.txt. It took some further investigation of logged headers to spot a minor header deficit that would lead to them getting the minimalist Disallow-everyone file. (I’d actually forgotten that this specific deficit gets them the minimalist version. I really should try to remember what my own site’s rules are ;) )
Perhaps I’ll poke a hole and see how they behave.