homepage Welcome to WebmasterWorld Guest from 54.197.183.230
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

    
How come pages are indexed within 30min?
shaunm



 
Msg#: 4487186 posted 12:23 pm on Aug 22, 2012 (gmt 0)

Hi,

How come some websites pages are indexed by Google in under 30 minutes? Is that only possible with frequently content updating sites like news sites, portals, forums? Or is that possible with static websites as well?

Can you help me to understand it better?


Thanks a lot!

 

Sand



 
Msg#: 4487186 posted 6:22 pm on Aug 22, 2012 (gmt 0)

It depends.

In my experience, Google will index new content more quickly if your site is regularly updated. When I post regularly, my content is normally indexed within a few minutes. If I take a month off between posts, it will take a little longer for the new ones to get indexed.

Second, many content management systems (like WordPress) ping Google & the other search engines each time a new piece of content is published. Google will come pretty quickly and index the new content. If you aren't using a CMS, you can do this manually if you want to by using pingomatic.

If that isn't working for you, you can also login to Webmaster Tools. Do a fetch as Googlebot on your new piece of content, and then submit it to the index. I've found that it will normally be indexed within 24 hours through that method.

netmeg

WebmasterWorld Senior Member netmeg us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4487186 posted 6:54 pm on Aug 22, 2012 (gmt 0)

My record for a post being indexed is about three minutes. Of course, a lot of my content is time sensitive, it gets tweeted and FB shared as soon as it's posted, and I use pubsubhubbub as well.

It also depends on how Google has learned to see your site - does it update often or only every once in a while; is it a "news" site or an ecommerce site, do you have a lot of duplicate content or navigational issues that might have slowed your crawl rate - there's no one thing you can point to.

If you are diagnosing a problem, then the first thing I would probably do is go into Webmaster Tools and view your site as Googlebot, look at the various entries under "Health" to get a grasp on how Google is viewing your site.

I also note that posting to Google+ pages definitely seems to help as well.

lucy24

WebmasterWorld Senior Member lucy24 us a WebmasterWorld Top Contributor of All Time Top Contributors Of The Month



 
Msg#: 4487186 posted 9:19 pm on Aug 22, 2012 (gmt 0)

And the obvious: How big is the site? In traffic, not pages. If you change a page several times a day but it only gets three human visitors a week,* g### is not going to start coming by every hour on the hour.


* That is: Three google clicks, or three people using Chrome, or three links sent via gmail, or something similar that google can measure. Your mother doesn't count.

louieramos



 
Msg#: 4487186 posted 11:06 pm on Aug 22, 2012 (gmt 0)

Google indexes every new post on my personal SEO blog within minutes of being published, I am using wordpress and my blog is ranked pretty good on a lot of SEO related terms in Google Australia, UK, Canada & USA, so that must be the reason why.

I also make sure I only publish unique high quality relevant content on my blog.

shaunm



 
Msg#: 4487186 posted 9:51 am on Aug 23, 2012 (gmt 0)

@Sand
Thanks for the useful tips :)

By the way, Is pinging get my websites pages indexed faster than leaving it for the bots to arrive themselves?

Also, what do you mean by 'regularly updated'? Evey hour? Or is there a limit like this many posts per day?

Thanks,

shaunm



 
Msg#: 4487186 posted 9:53 am on Aug 23, 2012 (gmt 0)

Thanks netmeg )

shaunm



 
Msg#: 4487186 posted 9:59 am on Aug 23, 2012 (gmt 0)

@louieramos

That's great! Can you tell me how often you update contents on your website?

Thanks,


@lucy24
* That is: Three google clicks, or three people using Chrome, or three links sent via gmail, or something similar that google can measure. Your mother doesn't count.


I don't get this, can you please elaborate it? Does that mean clicks from Google properties increases the chances of being indexed faster?

Thanks,

louieramos



 
Msg#: 4487186 posted 10:25 am on Aug 23, 2012 (gmt 0)

@shaunm, not very often just once a month or every 2 months.

shaunm



 
Msg#: 4487186 posted 10:30 am on Aug 23, 2012 (gmt 0)

@louieramos
not very often just once a month or every 2 months.


Oh, then how come your pages are indexed within 30 minutes, if frequent update is the key to getting pages indexed fast?

Thanks!

louieramos



 
Msg#: 4487186 posted 11:40 am on Aug 23, 2012 (gmt 0)

For some reason Googlebot loves to hang around my site

netmeg

WebmasterWorld Senior Member netmeg us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4487186 posted 12:26 pm on Aug 23, 2012 (gmt 0)

It's not the ONLY key. With Google there's never just one thing. It's always the mix of things.

shaunm



 
Msg#: 4487186 posted 1:04 pm on Aug 23, 2012 (gmt 0)

@louieramos

It's not the ONLY key. With Google there's never just one thing. It's always the mix of things

Like to see your site structure, if possible :)


@netmeg
It's not the ONLY key. With Google there's never just one thing. It's always the mix of things


Can you please tell me what those things are other than pinging?

Thanks,

netmeg

WebmasterWorld Senior Member netmeg us a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month



 
Msg#: 4487186 posted 1:59 pm on Aug 23, 2012 (gmt 0)

You should probably read up on some of the many many many previous posts here.

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved