Forum Moderators: open
Here are spme questions.
--How often will the new google index change and recalculate PR?
--Did Esmeralda get it all?
My older sites still rank fine but my newer ones did not do as well as I expected. It's almost as though all backlinks were not figured in yet to the PR calcs.
Thanks,
The main change in data started 2003-06-15 with lots of new stuff being poured into -fi, spread to one extra datacentre per day each day, and ended with -in being the last to get the new data on 2003-06-22. This data was collected in the last 10 days of May, and from at least part of June.
[edited by: g1smd at 12:38 am (utc) on June 30, 2003]
First your site was ranked top ten, then it wasn't. Then your index page was in, then it wasn't. Then the index shifted three times an hour for a week straight. Then GG went really quiet. Then webmasters went really noisy. Then you asked the question that no one but G can answer. Where are we now? Know one knows but Google (I'm not even convinced about that).
What we do know!
- Google appears to have been switching indexes (major tweaking) for two weeks.
- The Google bot formerly known as FreshBot [google.com] is now acting like a full crawler [google.com].
- Google appears to be full crawling [webmasterworld.com] the web at the moment. I say "appears", because there have been some conflicting reports. Some are getting full crawls and others are not.
- The index does appear to be fairly "fresh" at the moment with recently spidered pages showing up in classic "everflux [google.com]" style.
What to expect?
Highs in the mid to upper 90's, 30% chance of scattered showers, and Google's index continuing to change.
What to do?
Go back to site building the old fashioned way and forget about Google for now. (remember, Yahoo now owns Ink, and the days of Google on the 'hoo are numbered...think about it)
Some new data has been added to the mix.
What happend? who knows, will it stick? I hope so!
Maybe because I broke down and wore my Google shirt in public today, the Google Gods smiled on me.
Can you summarize Esmeralda? I think Brett pretty much summed it up!
Experienced update watchers also know to look for what people don't mention as well. For example, during Dominic some people weren't getting toolbar PR measures for a few sites. I kept a list of sites where the toolbar indicator didn't list PR because of technical reasons like url canonicalization/etc. Happily, most/all of the sites that I checked were showing PR correctly for Esmeralda--so I didn't see a lot of PR0 questions this time.
Another thing that people didn't mention on the update thread as much this time was spam. That matches with internal testing for Esmeralda, and the spam reports we received. The number of spam reports for Esmeralda was lower than for both Cassandra and Dominic, for example.
There were still people who claimed that Google was obviously, undeniably, irrevocably broken. I thought that there were fewer of them--but they seemed to post more loudly to compensate. :) I think the tone of WebmasterWorld has been a little more strident lately (sometimes because of uncertainty, sometimes because newer members are getting a feel for the community here), but I take it as a good sign that right now the majority of the threads are people trading analysis about things like Flash, indexing latency and crawl IPs, what type of filenames are best (me, I'm partial to hyphens), and so on.
Overall, I'd say that the Esmeralda switchover went relatively well. Of course, people who have specific comments can always send in feedback via a spam report and mention "Esmeralda". Also, I liked the pre-post moderation system that Brett and the mods started testing. It helped to keep related threads together; the mods have also done a great job of keeping discussions on-topic over the last couple weeks.
My problem is that I can see the same mirrored site group, and similar site group still dominating the SERPS. I gave you the details a number of time before, and you agreed they needed to be dealt with. They haven't been. But they have added to the number of their sites, thus pushing others down.
when will *any* PR show for post April 15th pages?
when will PR actually be updated for all sites?
When will the indexes where index/topical pages are found take control over the faulty indexes that are incapable of ranking pages correctly?
When can we expect that influx of page rank after the indexes are settled? (I can't believe this was it since obviously the www2 now can't find correct topical pages.)
Another thing that people didn't mention on the update thread as much this time was spam.
Courtesy Brett & Team and also the Pre-moderation system. Wait till the update ends ;)
the mods have also done a great job of keeping discussions on-topic over the last couple weeks.
I would generally agree. But it also started a Carrier Update Thread ie. Update thread is closed so start discussions on any thread which is remotely related to update :)
From looking at my logs it appears that the old idea of the deepcrawl coming from the 216 ip bank is now gone, and that 64 seems to be doing the work. We appear to have had major deep crawls around about every two weeks.
GG - if your still awake, will we see another dance this 4th?
Another thing that people didn't mention on the update thread as much this time was spam
I think that it has to do with the google forum pre-moderation. Spam has been discussed elsewhere:
[webmasterworld.com...]
I also think that because spammy sites have been back without any changes, people start to give up on the spam report.
so I didn't see a lot of PR0 questions this time
url canonicalization
Leo
But in re-reading #6 - there is a nice sub-text there kind of like Michael Fish on the BBC doing the storm storm reports (ok so maybe only the UK readers will get that one).
One thing that I have seen (again I wish I could quote search phrases) is that long search phrases "how do I make a widget out of balsa wood" appeared to have very good results last week (6/24-6/27) but the same search over the last two days is returing sites that just impact the two keywords (widget and balsa), whereas before I was getting better, logical results returned.
While doing this look at what is working well and what isn't, look at the differnce between the latest update and previous updates identify what you think are the key factors and test them.
The one thing I would say is that with the last two Google updates Dominic and Esmeralda, things have changed and the tried and tested formula for Google that many people were using is not working in the same way that it used to.
I love the way GG and Brett keep saying "stick to the basis, don't make tune-ups with every update. Just build your site for usability and not for Google".
That is a very good advice for a long term strategy.
Very good advice from Ian Turner.
The one thing I would say is that with the last two Google updates Dominic and Esmeralda, things have changed and the tried and tested formula for Google that many people were using is not working in the same way that it used to.
I will wait till the end of the update to say this bcoz I still feel that the tried and trusted method for google might work. HTH ;)
And I do still have an index page problem. A page that ranked number 1 for its keyword has now disappeared completely. It's still number 1 at www2, www3, sj, fi, cw, ex... But on www here, nowhere to be seen.
Someone used an analogy about websites being highways and SE being on ramps. Well, if Rand McNally won't list your new toll road on any of it's atlases, (published under many different names) you ain't gonna get many people using your road, even if it's a good one.
Brett mentioned Inktomi and focusing more on other engines. Interesting thought, becuase their bot has been more active on my newest site than Google. Hmmmn.....
My persisting query about Esmeralda however is also on the index page topic. I like the idea that subpages can come up more for specific search terms - that brings a breadth of traffic to a site across a range of terms rather than them all using the front door. However, I think it's right and even obvious that if you search for the name of the site then you should get its index page first, before any subpages. If you search for my site name now (in my profile), the first page you get is one that has only one incoming link and that is from the homepage. Every page in my site links back to the homepage, so it should be obvious to the googlebot which page is the index.
I could optimise my index page further with H1 text and anchor text on the incoming links, but this really should be unnecessary. Most websites are not built by people who know anything about SEO and Google should still be able to locate their index page if you search for their site name in most instances, in the same way that from a user's point of view it's good that IE can display invalid HTML in a correct fashion.
I'm not actually particularly bothered myself about my index page ranking currently as I'm about to completely relaunch the site, plus most of my traffic comes to deep pages anyway - but I think that it's an important Google principle that site name searches should bring up the index page of the site when it's made at least a bit obvious.
The one thing I would say is that with the last two Google updates Dominic and Esmeralda, things have changed and the tried and tested formula for Google that many people were using is not working in the same way that it used to.
I can tell you that I have not changed my basic formula since mid 2000 and it works fine. Yes there has been some fine-tuning that has been done as google and webmasters are playing chinese checkers, but the basic works. Few minor changes observed over the last 6-8 months:
1. Factors other than page rank have slightly more weightage; or pagerank is being calculated slightly different.
2. Alt text in text links is not being counted
3. Reciprocal links are being negated.
4. DeepFreshBot
5. 100 outbound links per page limit introduced.
6. Some other similar minor stuff
Other than this it is same same same
during these times all you can do is continue to build your site for usability and try to increase the conversion rate
I think the issue is 'my target page has been filtered'. I don't think Google has a problem with index pages, I think Google has a filter for SEO targetted pages (lots of perfect links etc). Your target page is usually your index page. I have a site where the index page was never important - there are lots of quality links aimed at a specific product page. The product page ranked highly for the main key phrase. Now that product page has gone from the SERP (95% of the time) and the index page is on page 2 or 3 (where it always has been), The index page hasn't been affected but the target page has.
Would somebody please summarize update Esmeralda
Looks freaking great to me except for select index files flailing around like mexican-jumping-beans.
I'd rather they were there briefly than not there at all
That's why I'm keeping the faith & attempting to premoderate myself until Google gets a handle on it; over 2 months of biting my lip has taken its toll on my big mouth.
<<<Fluxing from #1 to #6 is one thing. From #1 to nowhere on a kw seems a bit harsh. Something ain't right.
mfishy,
I am completely with you. I am not going to sit here and take the explanation that everything is ok, because its not. While everything is "OK" for some people, it's not for others, this is quite obvious.
<<<I think Google has a filter for SEO targetted pages
Ok so maybe it does, which would be a good thing, IF it didn't accidentally hurt people that weren't abusing. The problem is, is that it seems to be penalizing GOOD sites. Ya sure, I have an H1, I have anchor text in my backlinks, kw in title etc., but I thought that was GOOD? I am not abusing anything or using any cloaking crap or stuffing kw or hidden text - NOTHING.
I am getting VERY aggrivated that my index page is gone, and want to know why. I realize that everyone has a theory, but why can't we just have some kind of a "authentic" explanation? My site started at PR7, now is PR4, and I have quite a few PR8's for backlinks, NONE of which are showing (which seems to be why I went to PR4). Ya, I'm angry. HELL Ya, I'm whining. Ya, I'm confused. Ya, I keep changing little things here and there, because I don't know what else to do. I'm not going to make 20 new sites. I'm not going to build content build content - I already did. In my "niche", there's only so many pages one can build. I was doing just fine for my liking, BEFORE this mess.
(Rant over - I'm sorry, but like some people, I have just had it.)
This theory holds no water with what I am describing. If they were filtering some pages, there would be no reason for these pages to pop up #1 SOMETIMES and then vanish.
I have a difficult time believing that this has been the smooth transition/update that GoogleGuy describes.
I assume Google's goal is to display the best/most relevant SERPS to the user at all times. I can see no reason, other than a glitch, as to why it would benefit anybody to completely lose pages and then "find" them later- scoring the very same pages #1 that were nowhere in sight an hour ago.