Google Not Indexing Certain Pages

[akropp]

hey, i know this question has been asked numerous times as i've read through many of them trying to solve my own problem. i run www.example.com and i'm trying to get the individual <widgets> to be archived. i set up mod_rewrite to get rid of all the dynamic pages, i got rid of user sessions, i got rid of forms, i removed funny punctuation like periods and commas and whatnot in the url call, and yet still google only gets some of the pages. i know we get crawled frequently and i nkow it gets past the semester page, and to the <widget> page but i don't think its going much further. i'm wondering if anyone could maybe take a look and tell me if its just a matter of patience or if i'm still doing something wrong?

thanks

[edited by: ciml at 4:00 pm (utc) on Mar. 30, 2004]
[edit reason] Examplified and widgetised. [/edit]

[MHes]

Hi akropp

Welcome to webmasterworld

I don't know if others are seeing the same, but since Google left the monthly update for continual updates with 'everflux' and 'constant adding of new pages', we seem to have instead a 'take a few pages and add the rest in a few months' attitude.

I sympathise with your position. It could be you have too few high pr sites linking to you, so Google is not yet interested enough. Alternatively the pages it is ignoring appear too similar to the ones it already has, with similar words/theme and maybe they look like doorway pages?

Probably the most realistic answer is that Google is just having to deal with so much data, it has become slow and you get in when your turn comes.... we are finding it is taking 2-3 months to get a large site fully indexed.

[BallochBD]

> we are finding it is taking 2-3 months to get a large site fully indexed.

Which is a great pity!

[RussellC]

I tend to agree. I have several older sites and they are not affected by the post Florida mess, but I just started a new site 1 month ago and although it has been deep crawled twice, the index page is the only page that is in the index so far. I am still waiting, and building backlinks, and waiting, etc...

[akropp]

ah. that makes sense. thanks for the info guys!