Site's fresh content appearing in Google SERPs straight away - how?

[gskot]

I was doing SEO research and stumbled upon a website <a large established website with 4+ million pages> which is able to populate google search with fresh content within minutes. The website page dynamically updates and so does google search.

How is this possible? I don’t see any way on this forum to post screen shots from website and google search to show you timing, so you would need to do the comparison on your own. Copy or post new question from/ to that website and then search it on google. You will see that google has it minutes! How is it done?

[edited by: aakk9999 at 5:53 pm (utc) on Feb 21, 2014]
[edit reason] Exemplified [/edit]

[netmeg]

I have an event site (much much smaller than the one you mention) and when I post a new event, I have often seen it indexed and ranking in ten minutes. I think the record was four minutes. (And no, I don't tweet them out when I create them, I tweet them out on the date of the event) I do use pubsubhub, but honestly, Google did that even before I installed it. I think somewhere it knows about sites where "fresh" matters and acts accordingly.

On my personal site, a new post generally gets indexed inside of a few hours - but that's usually tweeted and retweeted and otherwise shared, and that probably helps boost it along.

How it happens is probably related to good site architecture (internal linking) and efficient use of crawl budget.

[EditorialGuy]

I've had blog pages indexed and returned in search results almost instantly (presumably because of a feed to Google from Typepad, which hosts the blogs). Static pages from my two main sites take longer.

[deadsea]

You can "ping" Google when you have a new page. Many content management systems (such as WordPress) even have this feature built in.

I can't recommend any specific ping services or products here, but if you search on Google for "ping google content" you can find several articles that have recommendations for doing so.

Googlebot also watches everything that gets posted on Twitter. So if you tweet about your page as soon as it is written, Googlebot will find it within minutes.

[Mentat]

1. big sites have "dedicated G bots"
2. News sitemaps?

[support.google.com...]

[Tiggerito]

It could possibly be using pubsubhubbub which is a way to notify rss feed subscribers instantly about new URLs.

Submit a pubsubhubbub supporting rss feed into Google Webmaster Tools as a sitemap to encourage Google to subscribe.

[gskot]

Thank you for all your replies. Some of your suggestions may be true. Page source analysis have reveal links to google.com/doubleclick/ ; googletagservices.com/tag/js/gpt.js ; googletagmanager.com ; plus.google.com ; googletag.pubads and Breadcrumb