Forum Moderators: open
Well as far as knowing if your site being penalized, you probably won't know. Engines use different algorythms(complicated formulas) to determine this and they are constantlym changing. So you might be high on the search engines today, and way deep in the
search engines tomorrow.
You can probably try changing something on your site and then updating it to see if your ranking changes. But the only thing is, you still might not know because if you change it today and next week it ranks higher it might not be because of your modification of your site last week, it could be something you did in the past and the algorythm is now accepting something you did in the past as good.
As far as your question on being crawled and indexed,i believe that the "robot" that crawls your site is listed as "blahblah bot" as the user agent in your server logs. *I listed it as "blahblah bot" because we are not supposed to drop names here on this site, so it depends on the engine bot.
>Also, you should'nt worry about being indexed because your site will be indexed if you have other sites linking to you.
Hope this helps you out:)
frenzy77