Welcome to WebmasterWorld Guest from 54.162.157.249

Forum Moderators: open

Message Too Old, No Replies

Is Freshbot now Deepbot?

The line is getting drawn ever thinner

     
4:18 pm on May 22, 2003 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I've seen several postings about this now in the last few days, although this is my first actual experience of it.

I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).

It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.

In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.

I'm interested in hearing from others who are seeing the same.

TJ

8:24 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>However, we're still in the transition period for this system, so I wouldn't be surprised to see a traditional update for a little while longer.

I think that the quote above is highly revealing. Note the reference to "in the transition period for this system." This would explain a lot why Google is so broken at the moment. they are moving between systems, and not to gracefully.

As to trillianjedi, depends on what the new baby look like. ;)

8:42 pm on May 23, 2003 (gmt 0)

10+ Year Member



rfgdxm1,

I was about to make a similar comment. I think what GG meant by system was process. I could be wrong though but you're right in saying it's very revealing.

8:46 pm on May 23, 2003 (gmt 0)

10+ Year Member



"I wouldn't be surprised to see a traditional update for a little while longer. "

Could someone please translate this statement?

8:47 pm on May 23, 2003 (gmt 0)

10+ Year Member



What is more important here is if this a one time situation or will google stick to less frequent updates from now on.

Are we facing the end of monthly updates?

Enrique

8:55 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



"I wouldn't be surprised to see a traditional update for a little while longer. "

Could someone please translate this statement?

I think you need to put it back in its original context:-

...we're still in the transition period for this system, so I wouldn't be surprised to see a traditional update for a little while longer.

Then fix the poor English (your school teacher use to pull his hair out in English class didn't he GG?!):-

"...we're still in the transition period for this system, so don't be surprised if you do not see a traditional update for a little while longer."

Which I believe means the new PR and backlink calculations will not be ready for between 4 and 7 weeks.

That may or may not mean that a new deepcrawl will happen in between, depending on whether they have advanced their freshbot technology or not.

TJ

8:58 pm on May 23, 2003 (gmt 0)

10+ Year Member



...they are moving between systems, and not to[o] gracefully.

Indeed. Seeing this sloppiness in action really surprises me. Google has bandwidth up the wazoo, 10,000+ dual cpu boxes, and plenty of smart people.

What suprises me is that they couldn't (or didn't bother to) figure out a way to do this "transistional update" transparently. It would seem they have the resources to have it working in the background while the usual update took place, even if that meant each process took extra time. Or at the very least, they could have had some decent freshbot activity/updates going on, as they appear to be doing now. As it stands, we have neither the usual update nor this incarnation of an update.

Maybe Joe User doesn't notice the difference. I find myself too far removed from that position to make a real judgement, but I have seen my Ink/MSN referrals increase recently. The only connection I can make is that Ink knows what's on my site as of this morning and their index is not far behind. Google did a fairly deep but very incomplete freshbot crawl on Wednesday/Thursday, but is still using an index from mid-April.

8:58 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Sure, reneewood. I would expect at least another update of the form where the crawl/index cycle finishes and then data centers are updated in the traditional dance.
9:08 pm on May 23, 2003 (gmt 0)

10+ Year Member



Sure, reneewood. I would expect at least another update of the form where the crawl/index cycle finishes and then data centers are updated in the traditional dance.

Good, GG. I had a few ongoing experiments that were dependent upon the normal cycle.

I sure hope there can be smoother "transistions" in the future though. This current update is no where near over but in my normal day to day searching Google has been less and less helpful. I'm sure hope that will be remedied shortly though.

9:10 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>Sure, reneewood. I would expect at least another update of the form where the crawl/index cycle finishes and then data centers are updated in the traditional dance.

And, where does this fit in terms of missing backlinks, anchor text, etc. being added back in? After these are added in? And, will this result in significant change in rankings when these missing backlinks, anchor text, etc. are brought in?

And, for those who haven't noticed, unless freshbot is also doing deepbot duties now, the deep crawl hasn't even begun yet. Which would mean that based on historical the crawl/index cycle pattern, expect at least a month before this happens, and perhaps longer.

9:14 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>I sure hope there can be smoother "transistions" in the future though. This current update is no where near over but in my normal day to day searching Google has been less and less helpful. I'm sure hope that will be remedied shortly though.

This update sure looks over to me. Looking at SERPs where there is little changes from freshbot, they have been solid for days. The only oddity is a number of strange toolbar PR displays. However, this is just a frill. What Google cares about is what shows up on the SERPs.

9:16 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Which would mean that based on historical the crawl/index cycle pattern, expect at least a month before this happens, and perhaps longer.

That's exactly what GoogleGuy is saying: "weeks not months", in other words something longer than a usual cycle.

Assume 7 weeks.

TJ

9:17 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member



dnbjason, I've learned never to make promises, but I would say the odds are good. :) rfgdxm1, more anchor text, backlinks, spam filters, etc. should be brought in by the next update. I think someone else remarked that freshbot is looking more like deepbot these days.
9:20 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member bigdave is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Assume 7 weeks.

Assume nothing would be my advice. Sort of like "don't promise anything"

It looks like Google is implementing a lot of new stuff in the coming months. We have no idea where the continuous update is in that list of priorities, and even if we did, priorities change and $#!+ happens.

9:22 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



> rfgdxm1, more anchor text, backlinks, spam filters, etc. should be brought in by the next update.

And, this will or will not effect rankings whenever this happens? If all this means is different results using the link: and allinanchor: commands, pretty meaningless.

>I think someone else remarked that freshbot is looking more like deepbot these days.

Hmm...VERY interesting that you picked up on this. I'll take the above as a significant comment. ;)

9:29 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member



I would definitely expect newer data that we bring in to affect rankings.
9:32 pm on May 23, 2003 (gmt 0)

10+ Year Member



OK, Open question - but hoping GG answers :)

I wonder if we should still be looking out for deepbot IP addresses over the next few weeks/days? ;)

10:29 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



>I would definitely expect newer data that we bring in to affect rankings.

I'd suggest people take very close note of the above by GG. If things go as he expects, this suggests a whole new way of Google updating. Up until now, other than freshbot there have been no major changes except at dance time. We may be moving into an era where between dances, there will be mini updates that can significantly change rankings as new data is brought in at that time.

10:32 pm on May 23, 2003 (gmt 0)

10+ Year Member



This is not what he is saying at all. He is saying that this will be a normla update process except freshbot may do the job of Deep. After the NEXT UPDATE we can expect the backlinks to be added
10:36 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



parabola:

"rfgdxm1, more anchor text, backlinks, spam filters, etc. should be brought in by the next update."

This is inconsistent with "After the NEXT UPDATE". I presumed from what GG wrote that he meant this would be added in at some unspecified time before the update. If not, feel free to correct me GG.

10:40 pm on May 23, 2003 (gmt 0)

10+ Year Member



Agreed - I am not sure

By the next update - in time before the next update

or

by the next update - the next update will do this

10:51 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Good point Dayo_UK. GG, could you please be a little less cryptic. ;)
10:52 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



rushes to GG's defense (although he is certainly capable of that him/herself ;) ....

hold on everyone, GG is here as a courtesy and on his own time. He offers information as he is able and cannot be expected to spell everything out in detail. His comments over this past update have been of phenomenal value! Yes, he has the patience of a saint -or- a grandparent watching over the youngins. :)

10:54 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Let me clarify. The next update should bring in more backlinks, data, etc. Those dang prepositions. :)
11:00 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member rfgdxm1 is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Thank you, GG. Which means that love the current SERPs or hate them, they aren't going to change until the next update. Those who have commercial sites that nosedived in the last update are probably grabbing a bottle of Scotch right now. :(
11:08 pm on May 23, 2003 (gmt 0)

10+ Year Member



Ok, so now we have got newer data being "gradually" brought in and, wait till the next update "Let me clarify. The next update should bring in more backlinks, data, etc. Those dang prepositions."
Can it be both of these? or maybe a better question for the GG. When will the very first piece of new data or the very first backlink that could affect rankings be brought in?
11:16 pm on May 23, 2003 (gmt 0)

10+ Year Member



Thanks GoogleGuy.

And those

dang prepositions
cause more or less interpretation, scotch, work, whining ;) This is absolutely no accusal, it's just because some of us folks hanging around a little nervous.

Constructioning Albert.

11:24 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member



rfgdxm1, I wouldn't go as far as saying that SERPs aren't going to change at all until the next update. Some amount of fluctuations might occur before then (e.g. a couple of small spam filters, or some fresher data).
11:25 pm on May 23, 2003 (gmt 0)

10+ Year Member



So, since GoogleGuy is glad that we've noticed freshbot going deeper, does this mean the deepcrawl is happening right now?

If so (or even if an official crawl is still yet to come shortly), I'd assume that April's crawl will be scrapped. Why bother with that data when new data is being collected?

11:30 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member googleguy is a WebmasterWorld Top Contributor of All Time 10+ Year Member



TheAutarch, the last deepbot crawl data can be used for cross-verification. It's also there as a safety-net back-up, but I don't think we'll need to use it.
11:35 pm on May 23, 2003 (gmt 0)

10+ Year Member



Those aren't exactly comforting words, GG. Worst case scenario usually isn't used unless some potentially bad things COULD happen. Only time will tell but even that raised my "Uh Oh" sensor.
This 211 message thread spans 8 pages: 211
 

Featured Threads

Hot Threads This Week

Hot Threads This Month