Forum Moderators: open

Message Too Old, No Replies

Waiting for the September Update

Looking forward and preparing for the update

         

apays14

5:03 am on Sep 19, 2002 (gmt 0)

10+ Year Member



I know that it's early but one of my sites just had about 40 pages indexed. Has this happened to anyone else?

Axacta

4:40 am on Sep 20, 2002 (gmt 0)

10+ Year Member



Well last month my site went from PR 4 to 5, my uniques have gone up 30%, and now this month, after a 6 month wait my site has finally been listed on dmoz. It's too late to make it into this update, so I'm already looking forward to October's update. ;) All in all, it looks to be a couple of good months! :)

oLeon

7:34 am on Sep 20, 2002 (gmt 0)

10+ Year Member



waiting for an update, yes, but:
our logs are speaking their own language, they say:
"your googlebot is here since the 11th of august, and you got referrers to pages which only have been created five days before they appeared in the index of google. what are you waitung for?"

there seems to be a bigger changing as we may expect, like an permanent update of pages which have good links, like an permanent spidering of pages/sites which also have an high PR. it was the first time, that pages got into the index that fast.

mack

8:06 am on Sep 20, 2002 (gmt 0)

WebmasterWorld Administrator 10+ Year Member Top Contributors Of The Month



Not so sure this between updates, update is entirely normal. One of my sites (with pr0) was spidered and updated only 2 days ago and is now in the main index. Normaly the fresh inputs are from sites pr6 and above?

Giacomo

8:14 am on Sep 20, 2002 (gmt 0)

10+ Year Member Top Contributors Of The Month



there seems to be a bigger changing as we may expect, like an permanent update of pages which have good links, like an permanent spidering of pages/sites which also have an high PR. it was the first time, that pages got into the index that fast.

Yes, I agree, oLeon.

What has been long awaited for is finally becoming reality:

As a rule, we don't preannounce new features. But the most important one coming up is more recency added to the search index. When I started at Google, the company was out of date, on average, every two weeks because the crawl was a monthly cycle. We want to get to the point where Google is updated on a daily basis.

We are working on algorithms to detect which sites are having high traffic or high page rank or high change rates. We want to make sure those pages are as current as possible.

  • From an interview with Eric Schmidt [pcworld.com] dating back to January 30, 2002.
  • Powdork

    8:20 am on Sep 20, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    "What has been long awaited for is finally becoming reality:

    As a rule, we don't preannounce new features. But the most important one coming up is more recency added to the search index. When I started at Google, the company was out of date, on average, every two weeks because the crawl was a monthly cycle. We want to get to the point where Google is updated on a daily basis.
    We are working on algorithms to detect which sites are having high traffic or high page rank or high change rates. We want to make sure those pages are as current as possible.

    From an interview with Eric Schmidt dating back to January 30, 2002."

    So are you saying Gbody doesn't love me, she just loves the fact that our chef put up tons of family pictures for lots of family and friends in New Zealand to see and download.:)

    Iguana

    11:19 am on Sep 20, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Has anyone noticed a correlation between GoogleGuy posting in the forums and the timing of the update? I've seen posts today and yesterday from GG and I wonder whether he normally disappears when an update is about to happen because they are all busy in preparation.

    I'm not particularly interested in this update as I can't really remember the changes I made more than a month ago. Being an optimist I believe that the work I've done this month is going to make me King of the Internet ;). Roll on October!

    ikbenhet1

    11:21 am on Sep 20, 2002 (gmt 0)

    10+ Year Member



    olean,

    that can be, but backlinks still get updated just 1 time a month.

    for example, my backlinks from 3 weeks ago that i got from linktrades, still don't show up in Google.

    nutsandbolts

    11:22 am on Sep 20, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Iguana: Yep, but have you also noticed you don't see him posting and a live picture of Tom Cruise on the TV at the same time? I'm sure it's the same guy ;)

    Iguana

    11:24 am on Sep 20, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    nutsandbolts

    That's true about Tom Cruise - I had always assumed he was Elvis because he only started posting after Elvis faked his own death

    dazz

    11:25 am on Sep 20, 2002 (gmt 0)

    10+ Year Member



    Nor a live picture of Danny Devito?

    ikbenhet1

    11:25 am on Sep 20, 2002 (gmt 0)

    10+ Year Member



    iguana, that i feel before every update, king of the internet.
    But after the update often i rank 'about' the same.

    But nice feeling do...;)

    Iguana

    11:33 am on Sep 20, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Yes, ikbenhet, it's a bit like buying a lottery ticket - you buy a few days to dream about what happens if you win those millions - before coming down to earth with a bump

    Jill

    12:50 pm on Sep 20, 2002 (gmt 0)

    10+ Year Member



    Well I hope the update comes soon. Our main site got buried to like page 6 but on www2 this morning we're significantly higher. I hope this is the beginning of the dance and we finally got on Google's dance card!

    martin

    7:28 pm on Sep 20, 2002 (gmt 0)

    10+ Year Member



    Google fetched 33 pages yesterday. They all are fresh today ;-)

    It's too early for an update.

    Chef_Brian

    8:30 pm on Sep 20, 2002 (gmt 0)

    10+ Year Member



    Hey Everyone,

    Sunday sounds good to me ... although with about four new sites online and tons of new links pointing to my main site I am more than ready for this update. I remember the first several updates when I launched my chef website about 15 months ago and how excited I got. Man, this is much more exciting. With so so much work of late I can hardly stand the anticipation of the "dance".

    Remember that song:

    Anticipation ...?

    Lets all hope for the best and possibly it will be this weekend.

    Chef Brian

    wharsono

    6:21 am on Sep 21, 2002 (gmt 0)

    10+ Year Member



    Oh please no fresh crawling on every page, my bandwidth only 100mb

    bcc1234

    9:27 am on Sep 21, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    I set up a new site about a month ago. Eight days later I had over 2.5k pages crawed. If the site gets into this update then google is truly getting good.

    rfgdxm1

    10:19 am on Sep 21, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    >It's too early for an update.

    No. The update most definitely has NOT started yet. However, if you check:

    [webmasterworld.com...]

    The dance is due to begin. Likely it could happen starting anytime from now to within the next few days or so. However, there was that weird exception of March, where the March update didn't happen until April 6, so anything is possible.

    Rest assured that someone will post of when the update happens with an hour of it starting here. Last month I had the distinction of making the first post here announcing the update. There is enough people around here who periodically check for the new update that it won't be long when it happens that somene will start a "The Google Dance has begun!" thread. ;)

    Helpmebe1

    10:34 am on Sep 21, 2002 (gmt 0)

    10+ Year Member



    Ill put $30 on Sunday Alex.. why? Cause google likes Sundays.. the flip the switch and all head home and then come in to work Monday and flip the switch off and ..shazam... another month is done.

    Why $30? Cheap? No you cant call me cheap.. we are a young company .. investments dont go on betting... they go back into the company... Sunday is a guess.. and thats all it is... as of now though.. no no update...

    brotherhood of LAN

    10:40 am on Sep 21, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month



    The weekend is a good time for google because overall net usage is low.....and not as many people are pounding their servers.

    However, late Saturday is even better ;) ;)

    rfgdxm1

    10:54 am on Sep 21, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    If you look at that update chart in the link above, while there definitely did seem to be a preference for Google to update on Sunday or Monday before Jan. 2002, that definitely isn't the case now. There has only been a single update this year on Sunday (PST), and none on Monday. If anything, it looks like Google is preferring to avoid Sunday and Monday updates now.

    However, I don't see a clear enough pattern at all this year to believe updates happen other than randomly throughout the week. It looks like they throw the switch whenever things are "ready" to do so. The only pattern in that it appears in the last year that things have never been "ready" before the 20th of the month. In fact, it looks like in March it took until April 6 for things to finally be ready.

    Helpmebe1

    11:06 am on Sep 21, 2002 (gmt 0)

    10+ Year Member



    good call! I didnt notice their was only one sunday this year.. i just looked at the bottom and thought I recalled the june update happening on a sunday.. ok so its ealy here in the states and i didnt have my coffee yet. For net using be low on a sunday I totally disagree. Everyone is on the computer sunday night..checking their email getting ready for the work week.. picking up the things they didnt get to over the weekend... sunday night has been a very busy night for us... we seem to get a fair amount of orders... I have to disagree.. possibly sunday during the day is a low net usage time but sunday night is a busy time IMO

    rfgdxm1

    12:01 pm on Sep 21, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Right. I happen to regularly exchange e-mail with several Internet sysadmins. Sunday night is definitely peak prime time, just like TV. If Google were timing update to occur at off peak times, the ideal time would be just after midnight on Saturday morning. Business usage is near non-existent on the weekends, and Saturday isn't a particulaly popular day for home users on the Internet.

    Hmm...while it may well be random, I notice that since June 2001, not only has there not been a single Monday update, there also hasn't been a Tuesday update. Thus, for those trying to spot a pattern to make predictions, if the update doesn't happen today or Sunday, then it might not be until Wednesday.

    politicsandlabor

    12:57 pm on Sep 21, 2002 (gmt 0)

    10+ Year Member



    The sites that i create were all spidered over Labor Day weekend. The changes that I made to my first paragraphs of text showed up overnight in my search results, but the cached pages are still the old versions.

    If google is so concerned about "freshness" why do so many results contain so much material that has been offline for so long? (in some cases, years?) For example, there was a big politics and government ISP/portal in Boston that went bankrupt (and went "dark") and for over two and ahalf years, it's old content was listed with Google- lots and lots of "error not found" messages.

    I don't get it. Wouldn't fresshness mean flushing the stuff that has gone away as much as catching new content?

    martin

    4:50 pm on Sep 21, 2002 (gmt 0)

    10+ Year Member



    >I don't get it. Wouldn't fresshness mean flushing the stuff that has gone away as much as catching new content?

    Yes, they could also cache DNS results for a shorter period.

    Dave_S

    5:08 pm on Sep 21, 2002 (gmt 0)



    I need to find out if google has looked at my internal pages, my new site has its home page showing in the results on and off since 12th sept, but everytime it re-appears its still without any (more pages from ....) listing.

    Is this normal for a new site? do i have to wait untill the update for the other pages to show? or should i start looking at my logs now to see whats what?

    Anyone suggest a good free program that will show me what pages within my site have been visited by googlebot?

    martin

    5:28 pm on Sep 21, 2002 (gmt 0)

    10+ Year Member



    >my new site has its home page showing in the results on and off since 12th sept, but everytime it re-appears its still without any (more pages from ....) listing.

    Your home page has only been freshed out.

    Probably the other pages and not refreshed and with only one page in the index you can't expect a "more results from..." link.

    >Anyone suggest a good free program that will show me what pages within my site have been visited by googlebot?

    [analog.cx...]

    Dave_S

    5:41 pm on Sep 21, 2002 (gmt 0)



    so i cant expect to have any internal pages indexed the first time google finds my new site?

    Should i just be patient and hope they are picked up next month then?

    Or panic and try and work out why they havnt appeared?!

    bcc1234

    9:56 pm on Sep 21, 2002 (gmt 0)

    WebmasterWorld Senior Member 10+ Year Member



    Why would they need to time their update with the lowest usage interval?

    As far as I understand, after the new index is ready (the one shownig on www2 and www3) - they just start replicating in onto the rest of the boxes one by one (I'm sure it's not done manually).

    So why would they care about the usage levels? From the visitors perspective both the new and the old indeces are good, so it does not matter if the query will be served by the updated box or not.

    And from the traffic-handling stand point - they claim that if they loose 50 boxes at once, they are not going to be affected.
    So they probably update their stuff in automated bulks. Like some N number of boxes goes off-line for replication, as soon as they are done, they go back on-line and the new N boxes are taken off.

    I'm sure their utilization is not near 100% so they can afford to take some number of boxes off-line without taking a performance hit.

    mundonet

    5:48 am on Sep 22, 2002 (gmt 0)

    10+ Year Member



    Yep, I see many "20 Sep 2002 - Cached" on www3 and we have a few new pages way, way up there. :)
    This 256 message thread spans 9 pages: 256