How to tell if we've been penalized?

any hints

[webdevsf]

Is there any way to tell if my site has been penalized by Mt. Googolympus? I have a PR 5 (which still shows up on the toolbar) and my site still has several thousand pages in the index. However, my SERPs have dropped off by 90% since the last dance.

I had some problems with the deep crawl last month (my server had an invalid robots.txt) but I'm not sure if I should wait for a few weeks, or try something different?

[EliteWeb]

If you have had invalid robot files fix it and let it do its thing this time around. I wouldnt say penalized in your case just need to have it taken another look at by the bot this time around.

The ones above you, do they seem like they worked up their ranking to outrank you, or does it seem like your site wasnt crawled right so it wasnt included in the results like it would have been if it were fully crawled?