Google Crawl Depth Since the End of Deepbot

Will big sites suffer?

[billygg]

well, as most of you people have noticed the deepbot has disappeared, and i havent seen to many posts on the google restructuring. Seems like google is in the process of completely changing the way it scans pages, or in the process of designing something. So... the question, has the deepbot disappeared for ever, and if not what changes are going to happen when it comes back. I have one idea that many page sites, like macromedia for example, will get less importance. As i have seen, the more pages within a site, the more backlinks appear to the home page, i feel one change will include dropping backlinks to your other pages within your site. ETC.... one site that i have optimized for google had almost 100 backlinks, now only shows 11. and its a PR of 6, all internal links have been removed, and it dropped to 6th page. This is just my opinion of course, any other ideas as to what is gonna happen in the next month........

[troels nybo nielsen]

I personally believe that Google are trying to reach a situation with individual crawl patterns for each website and for each page on a website.

Some guesses:

Google will try to visit "important" pages often and keep them fresh in their database. A page is considered "important" by Google, if it fulfills a combination of demands. Some of those demands might be:

1. It has incoming links from "important" pages.

2. It is doing well in SERPs for competitive search terms.

3. It is updated often.

4. It is situated on a website that generally is updated often and gets many new pages.

This is more or less what Google have been doing for a long time. But I believe that they are trying to differentiate the treatment of pages to a much higher degree. And one of the consequences may very well be that "unimportant" pages on large websites are crawled more seldom.

But I'm only guessing.

[dirkz]

had almost 100 backlinks, now only shows 11

Google's backlinks facility is totally unreliable at the moment, showing backlinks that are not counted and not showing links that are counted.

With the old update cycle every site got crawled deep, now the most resources are given to the highest PR sites IMHO.