Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Googlebot noframes spidering trouble

Error 500, but ok in the browser?



12:29 pm on Jun 21, 2001 (gmt 0)

WebmasterWorld Administrator 10+ Year Member

Google is comming and asking only for the default page and the robots.txt and leaving again. The site is loading nicely in the browser, the SEW Sim Spider is picking up all the pages too.

However, the new SEW Robots.txt Validator [searchengineworld.com] (great tool!) is giving an "Error 500" and Astra Site Manager is not able to access the site either.

It runs on Microsoft-IIS/5.0.

Could some of the tech experts give their 2 cents on this one as it is giving me a bit of headache?


10:21 am on Jun 22, 2001 (gmt 0)

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

Drop me the url in email or StickyMail and I'll have a look Rambus.

Featured Threads

Hot Threads This Week

Hot Threads This Month