| 7:38 pm on Feb 21, 2014 (gmt 0)|
I have an event site (much much smaller than the one you mention) and when I post a new event, I have often seen it indexed and ranking in ten minutes. I think the record was four minutes. (And no, I don't tweet them out when I create them, I tweet them out on the date of the event) I do use pubsubhub, but honestly, Google did that even before I installed it. I think somewhere it knows about sites where "fresh" matters and acts accordingly.
On my personal site, a new post generally gets indexed inside of a few hours - but that's usually tweeted and retweeted and otherwise shared, and that probably helps boost it along.
How it happens is probably related to good site architecture (internal linking) and efficient use of crawl budget.
| 8:19 pm on Feb 21, 2014 (gmt 0)|
I've had blog pages indexed and returned in search results almost instantly (presumably because of a feed to Google from Typepad, which hosts the blogs). Static pages from my two main sites take longer.
| 8:31 pm on Feb 21, 2014 (gmt 0)|
You can "ping" Google when you have a new page. Many content management systems (such as WordPress) even have this feature built in.
I can't recommend any specific ping services or products here, but if you search on Google for "ping google content" you can find several articles that have recommendations for doing so.
Googlebot also watches everything that gets posted on Twitter. So if you tweet about your page as soon as it is written, Googlebot will find it within minutes.
| 9:43 pm on Feb 21, 2014 (gmt 0)|
1. big sites have "dedicated G bots"
2. News sitemaps?
| 1:12 am on Feb 23, 2014 (gmt 0)|
It could possibly be using pubsubhubbub which is a way to notify rss feed subscribers instantly about new URLs.
Submit a pubsubhubbub supporting rss feed into Google Webmaster Tools as a sitemap to encourage Google to subscribe.
| 9:15 pm on Feb 24, 2014 (gmt 0)|
Thank you for all your replies. Some of your suggestions may be true. Page source analysis have reveal links to google.com/doubleclick/ ; googletagservices.com/tag/js/gpt.js ; googletagmanager.com ; plus.google.com ; googletag.pubads and Breadcrumb