Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Factors affecting how often a page is updated in Google's index

         

member22

10:41 am on Jun 22, 2014 (gmt 0)

10+ Year Member



Does google update a page in it index according to the PR of the page ( PR 6 gets crawled and indexed every day, PR 2 gets crawled and index every 3 weeks ? ).

Or according to the keyword " difficulty " ( let's say an easy keyword it takes 24 hours if you have a PR 6, a difficult keyword it takes 2 weeks instead of 24 hours if you have a PR 6 etc…)

Or according to the day of the week ? It take a break on sunday and doesn't bother indexing then…

rainborick

3:48 pm on Jun 22, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



My experience has always been that the depth and frequency with which Google crawls a page is largely dependent on the PageRank score of the page and how often the page itself is updated.

I had a recent experience that illustrates this idea. One of my sites had several thousand links coming from a hosting company's forum where I'd been active for over a decade, and it seemed like a good idea to get those links removed. The forum was mirrored twice - both of which somehow managed to get indexed by Google. So, last February I cleaned up my profile on that forum and soon started to see the link count drop in WMT. But, although the link count continues to slowly drop, nearly 1/4 of them still show some 4 months later, and I'm sure it's because those ancient messages hadn't changed in 10 years and also lack any significant PageRank.

netmeg

5:15 pm on Jun 22, 2014 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



I think Google also profiles types of content, and crawls and indexes accordingly. If I write a blog post, it'll usually go in within 24 hours; sooner if I promote it via social media and it gets RTs and whatnot.

Whereas, if I update or create a new event on one of my event sites, well, I think my standing record is about two minutes. (I didn't say ranking, I said *indexed*). Almost always within an hour or two.

It wouldn't surprise me at all if Google has identified what types of content tend to update a lot and what doesn't, and mixes that factor in with everything else.

There's also that whole "freshness" thing, where things that may be suddenly newsworthy or viral pop up to the top.