Forum Moderators: Robert Charlton & goodroi
Yahoo's Slurp is indexing my full site like crazy (and has been for months).
Now, I think I've fixed everything. I watched my logs eagerly yesterday night for Googlebot, and saw that:
1) The bot had visited
2) ...and Google indexed *one* page. That page happened to be the page I had last added to the site.
Is this normal? Are pages indexed slowly, one page at a time, or does Googlebot behave more like Slurp, where it grabs dozens of pages at once?
(My site's been around for a couple years, but I've only started adding valuable content in the last 7-8 months. I have about 100 pages.)