Google is comming and asking only for the default page and the robots.txt and leaving again. The site is loading nicely in the browser, the SEW Sim Spider is picking up all the pages too. However, the new SEW Robots.txt Validator [searchengineworld.com] (great tool!) is giving an "Error 500" and Astra Site Manager is not able to access the site either.
It runs on Microsoft-IIS/5.0.
Could some of the tech experts give their 2 cents on this one as it is giving me a bit of headache?
