homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Site's fresh content appearing in Google SERPs straight away - how?

Msg#: 4647538 posted 5:31 pm on Feb 21, 2014 (gmt 0)

I was doing SEO research and stumbled upon a website <a large established website with 4+ million pages> which is able to populate google search with fresh content within minutes. The website page dynamically updates and so does google search.

How is this possible? I donít see any way on this forum to post screen shots from website and google search to show you timing, so you would need to do the comparison on your own. Copy or post new question from/ to that website and then search it on google. You will see that google has it minutes! How is it done?

[edited by: aakk9999 at 5:53 pm (utc) on Feb 21, 2014]
[edit reason] Exemplified [/edit]



WebmasterWorld Senior Member netmeg us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

Msg#: 4647538 posted 7:38 pm on Feb 21, 2014 (gmt 0)

I have an event site (much much smaller than the one you mention) and when I post a new event, I have often seen it indexed and ranking in ten minutes. I think the record was four minutes. (And no, I don't tweet them out when I create them, I tweet them out on the date of the event) I do use pubsubhub, but honestly, Google did that even before I installed it. I think somewhere it knows about sites where "fresh" matters and acts accordingly.

On my personal site, a new post generally gets indexed inside of a few hours - but that's usually tweeted and retweeted and otherwise shared, and that probably helps boost it along.

How it happens is probably related to good site architecture (internal linking) and efficient use of crawl budget.


WebmasterWorld Senior Member Top Contributors Of The Month

Msg#: 4647538 posted 8:19 pm on Feb 21, 2014 (gmt 0)

I've had blog pages indexed and returned in search results almost instantly (presumably because of a feed to Google from Typepad, which hosts the blogs). Static pages from my two main sites take longer.


WebmasterWorld Senior Member 10+ Year Member

Msg#: 4647538 posted 8:31 pm on Feb 21, 2014 (gmt 0)

You can "ping" Google when you have a new page. Many content management systems (such as WordPress) even have this feature built in.

I can't recommend any specific ping services or products here, but if you search on Google for "ping google content" you can find several articles that have recommendations for doing so.

Googlebot also watches everything that gets posted on Twitter. So if you tweet about your page as soon as it is written, Googlebot will find it within minutes.


WebmasterWorld Senior Member 10+ Year Member

Msg#: 4647538 posted 9:43 pm on Feb 21, 2014 (gmt 0)

1. big sites have "dedicated G bots"
2. News sitemaps?



Msg#: 4647538 posted 1:12 am on Feb 23, 2014 (gmt 0)

It could possibly be using pubsubhubbub which is a way to notify rss feed subscribers instantly about new URLs.

Submit a pubsubhubbub supporting rss feed into Google Webmaster Tools as a sitemap to encourage Google to subscribe.


Msg#: 4647538 posted 9:15 pm on Feb 24, 2014 (gmt 0)

Thank you for all your replies. Some of your suggestions may be true. Page source analysis have reveal links to google.com/doubleclick/ ; googletagservices.com/tag/js/gpt.js ; googletagmanager.com ; plus.google.com ; googletag.pubads and Breadcrumb

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved