How come pages are indexed within 30min?

[shaunm]

Hi,

How come some websites pages are indexed by Google in under 30 minutes? Is that only possible with frequently content updating sites like news sites, portals, forums? Or is that possible with static websites as well?

Can you help me to understand it better?


Thanks a lot!

[Sand]

It depends.

In my experience, Google will index new content more quickly if your site is regularly updated. When I post regularly, my content is normally indexed within a few minutes. If I take a month off between posts, it will take a little longer for the new ones to get indexed.

Second, many content management systems (like WordPress) ping Google & the other search engines each time a new piece of content is published. Google will come pretty quickly and index the new content. If you aren't using a CMS, you can do this manually if you want to by using pingomatic.

If that isn't working for you, you can also login to Webmaster Tools. Do a fetch as Googlebot on your new piece of content, and then submit it to the index. I've found that it will normally be indexed within 24 hours through that method.

[netmeg]

My record for a post being indexed is about three minutes. Of course, a lot of my content is time sensitive, it gets tweeted and FB shared as soon as it's posted, and I use pubsubhubbub as well.

It also depends on how Google has learned to see your site - does it update often or only every once in a while; is it a "news" site or an ecommerce site, do you have a lot of duplicate content or navigational issues that might have slowed your crawl rate - there's no one thing you can point to.

If you are diagnosing a problem, then the first thing I would probably do is go into Webmaster Tools and view your site as Googlebot, look at the various entries under "Health" to get a grasp on how Google is viewing your site.

I also note that posting to Google+ pages definitely seems to help as well.

[lucy24]

And the obvious: How big is the site? In traffic, not pages. If you change a page several times a day but it only gets three human visitors a week,* g### is not going to start coming by every hour on the hour.


* That is: Three google clicks, or three people using Chrome, or three links sent via gmail, or something similar that google can measure. Your mother doesn't count.

[louieramos]

Google indexes every new post on my personal SEO blog within minutes of being published, I am using wordpress and my blog is ranked pretty good on a lot of SEO related terms in Google Australia, UK, Canada & USA, so that must be the reason why.

I also make sure I only publish unique high quality relevant content on my blog.

[shaunm]

@Sand
Thanks for the useful tips :)

By the way, Is pinging get my websites pages indexed faster than leaving it for the bots to arrive themselves?

Also, what do you mean by 'regularly updated'? Evey hour? Or is there a limit like this many posts per day?

Thanks,

[shaunm]

Thanks netmeg )

[shaunm]

@louieramos

That's great! Can you tell me how often you update contents on your website?

Thanks,


@lucy24

* That is: Three google clicks, or three people using Chrome, or three links sent via gmail, or something similar that google can measure. Your mother doesn't count.

I don't get this, can you please elaborate it? Does that mean clicks from Google properties increases the chances of being indexed faster?

Thanks,

[louieramos]

@shaunm, not very often just once a month or every 2 months.

[shaunm]

@louieramos

not very often just once a month or every 2 months.

Oh, then how come your pages are indexed within 30 minutes, if frequent update is the key to getting pages indexed fast?

Thanks!

[louieramos]

For some reason Googlebot loves to hang around my site

[netmeg]

It's not the ONLY key. With Google there's never just one thing. It's always the mix of things.

[shaunm]

@louieramos

It's not the ONLY key. With Google there's never just one thing. It's always the mix of things

Like to see your site structure, if possible :)


@netmeg

It's not the ONLY key. With Google there's never just one thing. It's always the mix of things

Can you please tell me what those things are other than pinging?

Thanks,

[netmeg]

You should probably read up on some of the many many many previous posts here.