Is this a googlebot crawl glitch?

If not, what could be it?

[przero2]

In this months' deep crawl, a quality PR5 existing well indexed site was spidered only 25% .. I was hoping the bot to pick up the rest of the pages later but there was no trace of it in the last few days. Checked to see if the server was down in any way and it was not!.
Wondering what to expect of this ...

[diddlydazz]

Hi PRZero2,

Google does this a lot in my experience, in my opinion it is nothing at all to worry about.

As far as I know all sites from time to time only get a certain percentage crawled.

Hope this helps

Dazz

[przero2]

diddlydazz, does it mean that Google includes only whatever small percent of pages crawled when it updates next or includes these recently crawled as well as uncrawled pages (but crawled and exists in the current index) in the next update. thanks.

[taxpod]

The best advice I can give, having been down this path myself, is verify that your title tags do not contain errors and there are no other "structural problems." If you find some, fix them immediately and wait. If you don't find anything like that, keep looking!

[24bit]

I'm in the same boat as przero2. My PR5 site was getting crawled all the time last month, now hardly at all. I haven't changed much except add a few pages. Oh well.

[przero2]

taxpod - this was a site that was crawled and indexed fully currently. so i did not suspect that there was any html issues. but i cheked to be sure. and sure enough you were right there were a whole bunch of unending font tags which are fixed now. may be last time the bot was not too specific about these tags and they are perhaps now.

in any case, thank you for the advice ... it provided me a chance to re-visit the pages and fix them for good.

[taxpod]

That's great that you found errors. I can't guarantee that this had anything to do with it. I'll hold my breath alongside you hoping that all your pages get crawled and indexed - and mine too :>

[BryantStevens]

I am having this issue as well. Last month I had about 5,000 pages indexed. This month about half that. And googlebot has not visited me since August 6th and has only take about 30 pages total! Damn. This sucks! And I just got promoted to PR 6 in the last crawl.