Msg#: 4647538 posted 5:31 pm on Feb 21, 2014 (gmt 0)
I was doing SEO research and stumbled upon a website <a large established website with 4+ million pages> which is able to populate google search with fresh content within minutes. The website page dynamically updates and so does google search.
How is this possible? I donít see any way on this forum to post screen shots from website and google search to show you timing, so you would need to do the comparison on your own. Copy or post new question from/ to that website and then search it on google. You will see that google has it minutes! How is it done?
[edited by: aakk9999 at 5:53 pm (utc) on Feb 21, 2014] [edit reason] Exemplified [/edit]
Msg#: 4647538 posted 7:38 pm on Feb 21, 2014 (gmt 0)
I have an event site (much much smaller than the one you mention) and when I post a new event, I have often seen it indexed and ranking in ten minutes. I think the record was four minutes. (And no, I don't tweet them out when I create them, I tweet them out on the date of the event) I do use pubsubhub, but honestly, Google did that even before I installed it. I think somewhere it knows about sites where "fresh" matters and acts accordingly.
On my personal site, a new post generally gets indexed inside of a few hours - but that's usually tweeted and retweeted and otherwise shared, and that probably helps boost it along.
How it happens is probably related to good site architecture (internal linking) and efficient use of crawl budget.
Msg#: 4647538 posted 8:19 pm on Feb 21, 2014 (gmt 0)
I've had blog pages indexed and returned in search results almost instantly (presumably because of a feed to Google from Typepad, which hosts the blogs). Static pages from my two main sites take longer.
Msg#: 4647538 posted 9:15 pm on Feb 24, 2014 (gmt 0)
Thank you for all your replies. Some of your suggestions may be true. Page source analysis have reveal links to google.com/doubleclick/ ; googletagservices.com/tag/js/gpt.js ; googletagmanager.com ; plus.google.com ; googletag.pubads and Breadcrumb