What Google Leaves Out

[tedster]

I just found this article that was published May 10. Forgive me if it's already been mentioned.

It's an interesting exploration into what Google doesn't index -- and as one of the experiments, it uses the word Googlology, coined right here on WebmasterWorld.

According to the Google front page, Google indexes 3,083,324,652 web pages out of an estimated 10 billion or so pages that are actually on the Internet. We ask the question, "What does Google leave out?"

Article at Microdoc News [microdocs-news.info]

[vitaplease]

Interesting question: what Google leaves out.

That article would suggest that you need recent links or updates to your older pages.

I wonder if their WebWolf crawler obeyed robots text?

I was also interested in the invisible web according to Google a short while ago: [webmasterworld.com...]

[tedster]

I think that's a very "blog-centered" study. Those guys thrive on freshbot listings, whether the individuals know it or not. But it was a heck of an interesting study, I thought.

Plus, who knew that "Googlology" had spread so far. It's even showing up in domain names now!

[Liane]

If the study holds water, wouldn't it make sense to re-upload your site every couple of weeks? Or even easier ... just use today's date on every page which automatically offers "new" content?

[vitaplease]

I would hope and think Google has more sophisticated systems in place that lets Freshbot detect real updated data.

[gstewart]

it uses the word Googlology, coined right here on WebmasterWorld

I'd no idea that my thoroughly daft posting had reached such a wide audience!