Update Dominic - Part 2

[teeceo]

Continued from Part 1: [webmasterworld.com...]

---

Thanks to google for letting us peek into there database( they could very easy close that door to us)and a thanks to googleguy for "DONATING" his time to answer question(that he don't have to) and for keeping thing here (somewhat) calm. Also, thanks to all that work so hard to keep this forum going strong(I for one don't know how I would get along without it:). I could go on and on but, thats all I will say. Later.

teeceo.

[Jane_Doe]

Thanks for keeping us posted GoogleGuy.

"An extensive knowledge is needful to thinking people - it takes away the heat and fever; and helps, by widening speculation, to ease the Burden of the Mystery." - Keats

[JudgeJeffries]

"Less baclinks due to the new algo"
What does that mean? Either the links are there or they are not there.

[NovaW]

I can only hope that the -sj index doesn't go google wide live exactly as is.

If so, there are going to be a ton of very happy webmasters that created relatively new sites heavy with on page factors that suddenly jumped up in the serps out of nowhere & a bunch of webmasters with well respected PR8 sites that suddenly get buried on page 5 after being in the top5.

All anybody can do is wait & see what happens. That update last sept was nothing compared to this.

[swampy webber]

Ok, maybe this means nothing but maybe it does. During the April Deep Crawl I saw one level of my site crawled followed by a day of almost no visits by the deep bot and then a second visit of very intense activity including many more pages. It appears that the results showing in SJ may be those from the first half of that deep crawl cycle. Hopefully the others are yet to come. Any comments or am I nuts?

The second half went to deeper levels

[edited by: swampy_webber at 7:51 pm (utc) on May 5, 2003]

[markusf]

Less backlinks due to the new algo

It means the batch process to add the backlinks hasn't been run yet...

[GoogleGuy]

You bet, Jane_Doe. I think these new changes are going to make webmasters and searchers much happier long-term. MrSpeed, glad to hear your page from four days ago made it into SJ.

[maardsma]

Hi All,

I find comfort in the belief that ultimately there is a link between the success of Google's visitors, the success of Google itself, and the success of Webmasters who depend on Google.

Google is about helping customers find what they are looking for, and webmasters are about being found by people who are looking for what they (the webmasters) have to offer. As long as Google is doing a good job of helping people find good matches (judged by the customer) for what they are looking for, then those webmasters that offer genuine good matches (judged by the customer) for what people are looking for will be found.

If the quality of Google's matchmaking goes way down (which doesn't seem likely based on Google's track record) this hurts the webmasters with quality content, but it also hurts Google's visitors, which hurts Google. I don't think Google wants to hurt themselves, so I fully expect ongoing quality search results from Google.

If Google's results continue to be high quality (as judged by the Google visitor) then I can't complain if various optimization strategies used by us webmasters don't work as well as they used to. It's Google's job to help searchers find what they want, not to help webmasters get a bigger piece of the pie than their less-optimized competitors.

Mark

[markusf]

Google guy you never answered my original question...

I have results in the SERPS that just list URLS and no description for the URL and no cache, these pages are from the deepcrawl. IS this normal? Its both on SJ and also in the regular april index.

[mifi601]

maardsma - welcome to webmasterworld!

[edited by: mifi601 at 8:09 pm (utc) on May 5, 2003]

[NovaW]

I'm confident in google's direction - they've done everything great so far. Also - of course not every search is going to be super optimal, but from my narrow viewpoint it's hard to understand a change that takes a 1 page PR1 site out of oblivion and places it well ahead of a hundreds of pages PR8 site that right now is sitting at #2 for a super competitive search phrase - but in -sj is like position #50 or something.

[Yidaki]

>I have results in the SERPS that just list URLS and no description for the URL and no cache, these pages are from the deepcrawl.

markusf, the update goes in batches (your own words) so maybe the description of the sites comes within the next week or two. ;)

It means the batch process to add the descriptions hasn't been run yet

don't throw bananas after me for that joke ...

[markusf]

Yidaki the update in april was completed weeks ago...

[GoogleGuy]

Ah, sorry I missed it, markusf. When you see the url but no cache, those are probably urls that we saw during our crawl but didn't actually fetch. We're sometimes about to return those urls for queries even though we don't have the page. I believe that such urls could show up in both the regular index and the SJ index. So yes, that's normal.

Hope that helps..

[Yidaki]

sorry, don't destroy my joke, please. You were at least one time refering to sj ... ;)

> Its both on SJ and also in the regular april index.

[markusf]

Google guy here is cut and paste from the serps.. Just a collection of links?

Domain/viewprofile.asp?profile_id=429
Similar pages

Domain/viewprofile.asp?profile_id=268
Similar pages

Domain/viewprofile.asp?profile_id=147
Similar pages

Domain/viewprofile.asp?profile_id=165
Similar pages

Domain/viewprofile.asp?profile_id=432
Similar pages

[poet22]

Just my opinion og GG last reply. Maybe no dance at all the way we know it to be. Maybe sj just starts showing up on other data servers with the right backlinks re sync'd or put in.?

[markusf]

Googleguy, deephot hit those pages and returned all the data.. (I just double checked my logs)

[iJeep]

Answering WebmasterWorld questions, then Google email, then WebmasterWorld questions. I hope no one expected much regular work from me today. :)

So what is "regular work" for GoogleGuy? ;-)

Also, should we report spam in the new sj results? Many have popped up using hidden text that I haven't seen around in a while. Also, there is a JavaScript redirect that ranks great in the new index.

[JamesH]

no more dancing?

[GoogleGuy]

Hmm. Any noindex or nocache tags? Could be a difference between regular vs. freshbot. The snippets you posted look like urls that we saw but didn't fetch though.

[Jakpot]

I'm worn out from reading 318 messages.
GoogleGuy - Thanks for sticking with us and for your
patience

[swampy webber]

Hi again,

Ok, nobody is responding to my comment so let me ask a question this time. I have been comparing some sites in the -sj index. Does anyone have dynamic pages consisting of more than one variable which are being included in -sj?

It appears that those are the pages not included for my site. Again, these were crawled during April but a day or so after the single variable pages.

I know Google has been doing better with these dynamic crawls but it just looks odd to me in -sj. I hope this isn't how it stays after the Dance. If so, I guess I have some work to do.

Do I have some work to do GG?

[GoogleGuy]

At some point I'll have to get back to Google work, but I'll try to check in from time to time to answer questions though..

[mauijaws]

markusf,

I have the same problem.
Could it be that 2 updates ago the pages were not in the index and now you just see freshbots.

In my case it would make sense.

See takagi post:
[webmasterworld.com...]

[markusf]

GG

I have no exclusion tags (header is the same across all pages), deepbot fetched the page and returned it , and freshbot feteched the page 5 times in march.

I track every single googlebot that comes to the site and each page it requests..

Markus

[GoogleGuy]

swampy webber, I think if you'll just wait those pages will eventually show up. If we were able to crawl them once, we should be able to do it again when we bring in more backlinks and start looking for more of your pages.

[GoogleGuy]

Markus, I would expect them to show up more over time.

[HenryUK]

Hmm: newer backlinks to be added over time.

Would that mean that a site that was seven years old, had backlinks from ages ago and was currently showing NO backlinks on sj was in some kind of trouble?

PS we are pretty clean I believe.

[GoogleGuy]

I wouldn't worry about it, HenryUK.

[nutsandbolts]

GoogleGuy, is there still more stuff to be added to SJ? Oddly, with an important set of keywords one of my sites has dropped badly - which is a shame as it's highly relevant, 100% spam-less and contains 99.9% more content than the other lot on there! ;)

[edited by: nutsandbolts at 9:01 pm (utc) on May 5, 2003]