Welcome to WebmasterWorld Guest from

Forum Moderators: open

Message Too Old, No Replies

Googlebot noframes spidering trouble

Error 500, but ok in the browser?

12:29 pm on Jun 21, 2001 (gmt 0)

Moderator from DK 

WebmasterWorld Administrator 10+ Year Member

joined:Oct 23, 2000
votes: 4

Google is comming and asking only for the default page and the robots.txt and leaving again. The site is loading nicely in the browser, the SEW Sim Spider is picking up all the pages too.

However, the new SEW Robots.txt Validator [searchengineworld.com] (great tool!) is giving an "Error 500" and Astra Site Manager is not able to access the site either.

It runs on Microsoft-IIS/5.0.

Could some of the tech experts give their 2 cents on this one as it is giving me a bit of headache?

10:21 am on June 22, 2001 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
votes: 15

Drop me the url in email or StickyMail and I'll have a look Rambus.