Forum Moderators: open

Message Too Old, No Replies

A question for senior members and mods

Is anyone uneasy about the scheduling change?

         

Liane

3:26 am on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I am not now and never have been an update hound. I am quite patient (and generally confident) when it comes to updates. However, I find the recent and what I consider to be erratic Google update schedule behaviour to be really quite disturbing.

I have always been a big Google fan and my admiration remains in tact ... but I am concerned that the recent displays of inconsistent update scheduling may have detrimental effects on the perception of Google's stability for webmasters world wide. I realize that it has only been a few months of erratic behaviour, but radical changes send up a red flag for me and signals that perhaps, like DMOZ, they may be experiencing technical problems which could drag on indefinitely. This isn't an unreasonable perception as we have all seen it happen to major search engines such as Alta Vista and Excite (amongst others) in the past couple of years.

We've also all noted that the Google team have been busy "tweaking" the algorithm substantially from month to month of late, producing glaring changes in the PR of various sites. They go up and down, links are lost and gained. But through it all, search results don't seem to change too drastically ... and inquiries don't seem to be affected to a large extent. This has provided a certain sense of security for us all. But is this a false security?

I have this nagging feeling in the pit of my stomach that something is wrong at Google. I can't explain it ... its just there.

The only other time this happened to me was when I "felt" there might be a problem with Inktomi. Certain things began to happen (at canada.com) and although I was assured by many in the know that there was nothing at all wrong ... it turned out in the end that I was absolutely right. It was, in fact, the beginning of what was a very major blip which took Inktomi nearly two years to recover from. In my opinion, they have never really recovered from that "blip" and it left a gaping hole in internet search which allowed Google to ride into the fray and pen the deal with Yahoo, which nobody can argue, kick started their domination as "the" internet search provider.

I've done little to my site since the last update and none of what I did was to try to advance my ranking in the SERPS ... so I can honestly say that I have no reason to have the jitters. My feelings are inexplicable I admit, and I apologize to those of you whom I may have managed to upset more so than you already might be. I just have that same nagging feeling I had when, what I refer to as the great Inktomi crash of 2001, took place. Its very worrisome.

My question is ... do any of the senior members and mods of WebmasterWorld have any of the same concerns? I have good reason to trust my gut instincts ... but (obviously) none of you do. I'd like to know if any of you have raised an eyebrow more than once in the past few months in regards to Google's update behaviour? If so, what are your concerns and why?

My apologies to GoogleGuy and those who feel this post may provoke a panic situation. My intentions are pure and I simply want to know if the senior members and mods feel that there may be something up at Google? If I were a member of the "subscribers forum", I would save this question for that arena. Alas, not yet ... but soon I hope! :)

europeforvisitors

4:27 pm on Apr 8, 2003 (gmt 0)



What's the big deal? Google is updating all the time. What do you think the freshbot is for?

BigDave

4:57 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I do think google cares what webmasters think, but I don't think they "cater" to them. No matter what they do, there will always be some webmasters in the bitch and moan club.

Many webmasters are in the power user position of being able to influence many people's decisions of how they are going to search. I don't think they are the most influential group, but they are up there.

If you want a consistant update cycle, what would you be willing to give up to get it?

Should Google skip QA testing and push out whatever they have on the due date?

Should they stop trying to increase the number of pages crawled? Stop trying to crawl dynamic pages better?

Should they stop trying to deal with spam?

I would personally rather wait than have Google update before they are ready. Even PhD's and super hackers can produce buggy code sometimes. I would rather that they catch as many as pssible before they ship.

cherryetc

5:05 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



the internet is still young if you really think about it.... and so is google :)

I sure do wish my crystal ball could show me what the internet will be like in five years.

It will be much more advanced that is for sure. Kinda like riding your bike to work, it sucks hehe... Imagine the se's in five more years!

I predict lots of changes thats for sure. Little google update delays are small details.

bobmark

5:21 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



I find the whole perspective on this bizarre.
Google has never really provided much info on the update in the form of press releases, etc. It is a part of the internal workings of their seacrh engine. It is only on sites like this that people first track the updates and then start to panic over their own self-imposed ideas of what the update schedule is.
Historically - at least since 2,000 - Google updates roughly every four weeks with the vast majority of the updates occuring from the 20th of the month to month end. You have to assume this month end pattern is somehow efficient or otherwise attractive to Google.
This pattern "drifts" periodically and you see early month or mid-month updates, but it always seems to resolve back to the month end pattern.
It should have been considered at least a strong possibility by most webmasters on here that given how late the "February" update was (beginning at the end of the first week of March) and then how long the deep crawl took afterwards that the next update might be as late as the end of the second or start of the 3rd week in April.
You can't invent your own schedule for Google updates and then post dire suspicions of problems when Google doesn't conform to your expectations - well, you can, but its crazy.

Birdman

5:26 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



bobmark, that is basically what I meant in message two. They never set a schedule, we did. Good call.

johnsmith2003

5:26 pm on Apr 8, 2003 (gmt 0)



Anyway Liane I have the strange feeling too, I know it's tough telling people what it's like but I know what you mean and I think you're correct. Been on this biz quite a while and that hunch has rarely been wrong ;)

Don't mind some overly supportive people around here, I also have a strange ticklish feeling there's more than 1 Google guy aboard ;)

Anon27

5:35 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



GoogleBot still very active in my sites, as seen here:

15 different robots Hits Bandwidth Last visit
Big Brother 2225 0 08 Apr 2003 - 18:00
MSIECrawler 320 337.19 KB 08 Apr 2003 - 16:11
Road Runner: The ImageScape Robot 222 882.80 KB 07 Apr 2003 - 04:18
Googlebot (Google) 55 1.27 MB 08 Apr 2003 - 18:03
LinkWalker 38 842.34 KB 06 Apr 2003 - 12:30
Alexa (IA Archiver) 36 1.07 MB 07 Apr 2003 - 15:23
Inktomi Slurp 26 528.13 KB 08 Apr 2003 - 10:52
Unknown robot (identified by 'crawl') 16 413.29 KB 08 Apr 2003 - 12:14
InfoSeek Robot 1.0 5 128.98 KB 03 Apr 2003 - 07:12
ZealBot 4 0 08 Apr 2003 - 09:52
Others 7 154.99 KB

killroy

5:54 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



But hey, it's fun nonetheless :)

I can just see it. GoogleGuys REAL job is probably to compile a summary of the most funny panic attacks and anecdotes form WW and send it aroudn the googleplex to raise their morale and ensure that "relaxed" and "friendly" environment.

hehe that one's on us

SN

jomaxx

6:35 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Looks like the monthly "where is the update?" freak-out is well under way. Things are progressing as per normal.

MrSpeed

6:41 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Looks like the monthly "where is the update?" freak-out is well under way.

Yeah but any longer and it will become the April update freak out.

ciml

7:02 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google update behaviour seems more erratic if you look at it too closely. When we notice it's erratic we tend to look still more closely, so this becomes a vicious circle. In other words Liane, it's quite normal to look too closely. :-)

Still, I do wonder when Google's next big change will be. It's that feeling of impending doom that reminds us to keep on Googlebot's good side.

Liane

7:22 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



My apologies to GoogleGuy and those who feel this post may provoke a panic situation. My intentions are pure and I simply want to know if the senior members and mods feel that there may be something up at Google?

Thanks Birdman, Marcia, Googleguy, Napolean, CIML and those of you who provided sensible answers without assuming that I am "panicking, freaking out or that I have a bizarre take on things". It was simply a question. I wanted to know if anyone else was feeling the same way. Now I know! :)

rfgdxm1

7:40 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The only thing different this time is that this is the first time the update has been "late" 2 months in a row. Not that I would say this is anything alarming; Google doesn't necessarily have a fixed schedule. Googleguy not giving any hints when it will be just increases the angst of webmasters here. However, his job isn't to help the mental health of said webmasters. ;)

Brad

7:56 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I am not worried. Google's record for updating is unmatched, so they are allowed to be late once in awhile in my book.

DrCool

7:59 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



I don't worry about it too much. It is always nice to see the update but I don't let it change how I work.

cornwall

8:59 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



For those with an interest in maths try this thread [webmasterworld.com]

The gist is that the average time between updates is 32 days with a mean standard deviation of 6 days.

Also given are all the update times

johnsmith2003

9:16 pm on Apr 8, 2003 (gmt 0)



ciml - your circular vicious update syndrome theory is excellent.

some also call it a negative spiral (read that term the first time on bill gates' first book) but here we'll just call it LABDO, what do you say?

(Lack of Anything Better To DO)

GoogleGuy

10:00 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Just a quick post, and maybe I'll be able to do a more substantial post soon. The short answer is that we care very much about webmasters, and we also care very much about quality and testing. The fresh crawl and its millions of pages per day help to find new results between crawls too..

Jesse_Smith

10:52 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



:::and we also care very much about quality and testing.

I think that explains why what we call the 'delay' is occuring. Yah, if I had a search engine with billions of listings, you can bet I would want the resaults to be quality resaults. Adding billins of new listings probably makes it take longer to test. I think we can probably expect future updates to be every 35-40 days.

GodLikeLotus

11:02 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



We have added several new pages over the last 2 weeks and ALL were appearing in the results after a couple of days with fresh dates next to them. Of course they then start to appear and then disappear as the do the fresh dates. This does seemed to have changed though recently, now all our pages seem to show updated cache versions even when fresh dates have gone. Is Google now adding new pages that stay in and having a monthly update just to caculate new PR's?

affiliateguy

11:31 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



:::and we also care very much about quality and testing.

Well you don't have to work too hard to beat out poor old altavista, I see google.com is listed on the second page of their results for the term debt consolidation. And Google is ahead of Yahoo! :o)

...unless you guys are cloaking over there?

skipfactor

11:36 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Googleguy not giving any hints...

Hey, he hasn't told us to take a few days off since that "way too early" many moons ago...

affiliateguy

11:43 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



... I think they are waiting until they get top spot on altavista for every search phrase before they update, I see google is up to #7 for credit report now, still ahead of Yahoo, aol and msn.... :-)

What tough competition for google over there!

killroy

11:47 pm on Apr 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I have a rather humble directory of a few thousand categories and listings... and yet I could take the year off, working only on the database and still not make it entirely "clean".

Large amounts of non-strict data, i.e. data that's not clearly defined like numbers, such as a textual database, isinherently messy and maintenance hungry. And maintenance cost is almost exponentially related to size of database.

I can understand the horror of the guy in charge of googles datasets. In fact what we call great and squeecky clean he probably considers with horror, begging the GG to give him a few decades to clean it up before resuming normal timeflow.

Good job guys.

SN

Visi

11:59 pm on Apr 8, 2003 (gmt 0)

10+ Year Member



My theories on the updates:)

Update would have happened by now...except GG has to keep coming to this thread to answer the posts. The little "red button" is located in the room opposite his computer and it is the result of the "is the google updated yet threads" that is slowing down the whole process. Since the google complex is streamlined so much, the doorways are "one way" only, meaning GG has to circle the entire building before getting back to the area. This forced exercise has resulted in numerous breaks taken by GG, in an attempt to recouperate. As a result, at this time he does not have the strenth to depress the button. <random theory>

Course we all know that it is a deceptive plan by GG to have something to discuss at the Webmasters conference:)<conspiracy theory>

intexap

12:23 am on Apr 9, 2003 (gmt 0)

10+ Year Member



I think we webmasters are at google's mercy and it sucks that they do not need to let us know anything that goes on.

jdMorgan

12:33 am on Apr 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Letting "us" know is letting their competition know - Would you?
GG's job is a very difficult one - walking the line between keeping us sane and telling the other SE reps what's going on at the 'plex. A tough job of diplomacy...

Jim
(I would not mind at all if they pushed the red "get Jim paid on his pay-for-performance job now" button, though.) :)

GoogleGuy

4:08 am on Apr 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



affiliateguy, I never noticed that before--kinda funny. Anyone have advice for how to make it into the top 10? :)

Marcia

6:15 am on Apr 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>Anyone have advice for how to make it into the top 10?

Of course we do, GG. But you might not like it and you probably won't do what we suggest. Two pages (links) back you put anchor text in a link with corresponding words surrounding and in the page title. Link to an intermediary page and from that page link to your target page from an image with an "alt" attribute. Bingo! Only catch is, you'll have to change your page title.

This will get you a #2 out of 826K for a blank page, but may not work for a page that actually has anything on it. I haven't tested for that yet.

Hollywood

6:41 am on Apr 9, 2003 (gmt 0)

10+ Year Member Top Contributors Of The Month



OK I see now, I think GoogleGuy may have just given us a very big tip and thus far I see not one person here may have picked it up.

Notice about his comment ... GoogleGuy said

"The fresh crawl and its millions of pages per day help to find new results between crawls too.."

I think all the talk of this Grub Client may have some substance to this, something tells me there is more into GG's short comments than meets the eye. The best thing anyone in the search engine world could ever do is come up with a Grub Client that works in Google.com's terms.

If this new client updated the web daily and ongoing using Googles algo we would have something am I right?

So why not stop monthly updates and start doing major freshbots all the time?

Am I missing something, I may be a few beers to deep so do not mind me, hmmmm am I close guys/gals of WebmasterWorld? Show me some love!

This 63 message thread spans 3 pages: 63