homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Is google getting faster in all aspects?

 12:10 pm on Oct 22, 2003 (gmt 0)

Just got two sites into the index withing 5 days. Small crappy sites, nothing to be proud of.

Also moved one site to another host and googlebot started hitting the new host in about 1 hour or so.

Is it just lucky me or is google getting faster at everything?



 12:26 pm on Oct 22, 2003 (gmt 0)

Good for you.

I moved host 5 months ago.
For fear of googlebot missing the move, I was sweating it out.
Googlebot found it within a day.

Are others having the same experience in moving hosts?


 4:11 pm on Oct 22, 2003 (gmt 0)

One of my sites which had been down for 6 months was indexed and assigned PR within a few days of going live again. I assume much of the speed in which google finds it has to do with the # of quality paths (links from good PR pages) one has to it the site. That and maybe some dumb luck.

<added> belated congratulations, Vitaplease</added>


 4:53 pm on Oct 22, 2003 (gmt 0)

Moved my domain last night. Googlebot found the new site before my local ISP's DNS switched over.


 5:40 pm on Oct 22, 2003 (gmt 0)

I moved host 5 months ago.
For fear of googlebot missing the move, I was sweating it out.
Googlebot found it within a day.

We try to make it seamless and fast for people moving hosts. Glad it's worked well for folks. My rule of thumb is to bring both sites up on the two different IP addresses and then switch the DNS to the new IP address. After you see Googlebot visit the new IP address, you can probably take down the old site. Doesn't hurt to leave the old site up a bit longer, but you shouldn't need to worry about it.


 8:10 pm on Oct 22, 2003 (gmt 0)

GoogleGuy, Googlebot switched to the new site asap, but Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html) is still pounding my old site.


 11:20 pm on Oct 22, 2003 (gmt 0)

Ive noticed freshbot has been freshtagging in unprecendented ammounts and picking up new domains within days. I love this game - months ago you had to brutally fight to get freshbot recognition, but now it is hard to get missed. However, many search engines have taken up the freshbot idea. I see a peak coming along any time now; where the only thing left to do, to improove results, is:
hire masses of minimum wage employees to manually filter out websites ( if they dont, i might )


 11:58 pm on Oct 22, 2003 (gmt 0)

Does little Googlebot ever sleep? He reminds me of a very hyperactive child always on the go.

GoogleGuy, Googlebot switched to the new site asap, but Mediapartners-Google/2.1 (+http://www.googlebot.com/bot.html) is still pounding my old site.

How did you switch over to the new site -- using redirects?


 12:06 am on Oct 23, 2003 (gmt 0)

We opened a 'new' site for a new client about a week ago, maybe 10 days ago. Same domain as they had with their old host, but hosted here now. Google still has the old site; new one hasn't been found yet. Admittedly, this is a site that freshbot would've tagged to ignore forever at the rate updates were made to the old site....


 12:10 am on Oct 23, 2003 (gmt 0)

never had a problem with hosts. i've just changed nameservers for a sight and it seems not to have any effect though the ISP is completly aware of my paranoia regarding things like that.


 12:24 am on Oct 23, 2003 (gmt 0)

I have a new domain. No links to it, it's very fresh. Just title and some text. I cannot imagine how, but I just checked logs and what I saw was couple whois inquiries and googlebot signature. It also already has PR0. Any ideas on how G picks up new domains?


 12:27 am on Oct 23, 2003 (gmt 0)

I did a redirect for the members login page. The rest of the site (40,000 pages) is mirrored between the old and new server.


 1:27 am on Oct 23, 2003 (gmt 0)

>> it seamless and fast for people moving hosts

That's great :) one thing less to worry about.

How about changing domain names? That's a bit more complicated with backlinks pointing to the old domain and all that - i know the spider's pretty quick, but is it still around three-four weeks for everything to settle all the way to the SERPS?

Any recent experiences - within the last month or so?



 2:50 am on Oct 23, 2003 (gmt 0)

I am absolutely amazed!

I created links to a brand new site on the 20th (which contains 1500 subdomains which are not linked from the front page :-) ).

Googlebot looked at almost all of the subdomains on the 21st and has deep crawled on the 22nd.

A really strange phenominon (imo) is that it found the subdomains apparently without viewing the pages which link to them! How is this possible, any ideas?

Best regards


 3:19 am on Oct 23, 2003 (gmt 0)

Just out of curiosity, why so many subdomains? In my experience subdomains and SEO don't fit well together...


 8:56 am on Oct 23, 2003 (gmt 0)

>> How is this possible, any ideas?

You can't really create an active subdomain or domain without telling the whole internet about it. Except for links(*), there's only one [google.com] way that googlebot can discover your new sub/domain ;)

If this is right, it's very cool. Only, it seems robots.txt should be the first thing on a domain now, i'm glad Googlebot respects it.


(*)and except for somebody submitting the URL's of course.

 5:22 pm on Oct 29, 2003 (gmt 0)


You bet it is getting faster, and by the looks of it, that spam-to-rankings turn around time has never been better with Google.


 6:48 pm on Oct 29, 2003 (gmt 0)

Well, Google manage to incorporate changes to my site in less than 24 hours. That's either impressive or very fluky. However, the issue is not how long does it take for Google to handle changes, it's how long it takes to lose those changes. Last time it was about 2 weeks. So if Google is getting faster at everything, I look forward to the changes vanishing from the index in around a week.



 7:37 pm on Oct 29, 2003 (gmt 0)

I must agree google is doing a phenomenal job indexing new sites (can you say toolbar viewed sites?) which makes life better for many webmasters. Also, their apparent speed at picking up sites that move hosts (with the amount of cheap fly-by-night hosting companies around...) is a breath of fresh air.

However, I think people are really missing the biggest point. If your new site/pages have PR0 (as all new sites initially are), you still have to wait about 5 weeks (or according to some here, what feels like a yearly cycle, lol!) before a Pagerank/backlinks update and only then can you rank good on competitive keywords. I have some PR0 pages that are #2 and #6 for two non-competitive terms, while the site's main page is #65 for a much more competitive term. Therefore, without that pagerank/backlinks calculation being completed, you are a PR0 site competing against PR5's and above.


 8:32 pm on Nov 6, 2003 (gmt 0)

I don't personally have any evidence of google using the toolbar to index sites (does anybody?).

My sites have only been indexed after links have been placed (or the subdomain phenominon mentioned earlier).
I have developed many sites over a few weeks - the indexing followed very shortly after inward links were placed.


 8:51 pm on Nov 6, 2003 (gmt 0)

Answer to limitup - why so many subdomains

I have a site which relates to 1500 Cities worldwide. I wanted a seperate URL for each City, so I used subdomains.

I consider a subdomain to effectively be treated as a domain but may be told otherwise by webmaster/seo's here with far greater experience than I :-)



 8:01 am on Nov 7, 2003 (gmt 0)

The site I mentioned up in msg. #9 above has finally been found by Googlebot. It crawled the new site yesterday (Nov. 5), almost a month after we moved the site/domain from the previous host to us.

Not as fast as others have mentioned, but I'm pleased with anything within a month, and as I said, that site hadn't been touched in years so the client should feel lucky Googlebot even remembered it at all......


 7:02 pm on Nov 7, 2003 (gmt 0)

I seem to be getting mixed results from Google.

One site has been indexed quickly and several hundred pages added within a couple of weeks, which was excellent.

Another site of mine had a couple of hundred pages added and then Google just hasn't touched it in about 6 weeks. There are hundreds more well linked pages to be picked up.

Another 10K page directory site was partially crawled 3 months ago and over a thousand pages were added to the index. Nothing since. It is very frustrating that Googlebot doesn't come back and do the job properly.

I get the impression that Google is doing an initial spidering very quickly (which is good) but not returning for a thorough deep crawl for a long time (which is bad).

I am also finding it difficult to know just how many pages are actually in the Google index - each datacentre seems to return a different number of pages (which is messy). Where I check from (UK or USA) also seems to influence how many pages are in a datacentre (which is weird).

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved