Forum Moderators: Robert Charlton & goodroi
They've been doing it a couple of times a day. I've looked around the web and many sites without a robots.txt file have all kinds of text returned.
I'm just wondering if perhaps I should have the standard apache 404 message be returned. I know for a fact that the 404 status is being returned.
Any ideas on if this indicates something?
PS: I've checked the number of listings these customers have and they don't seem to be dropping or anything?
PPS: we also upgraded to apache just a few weeks ago from an very old no longer supported http server called Website.