Forum Moderators: martinibuster
The equivalent in sitemaps makes no such mistakes. Odd very odd. The whole collection starts on the 27.4. up to today.
I haven't restricted Media nor Googlebot from any of those pages and checked there are no other bogus robots.txt anywhere on my server. The directory that is supossed to have a very small percentage of all my files excluded isn't actually in the robots.txt which is unchanged since years.
I don't know what the hell it's doing, i emptied the robots.txt now, but I am 99.9% sure I didn't make a mistake.