Forum Moderators: open

Message Too Old, No Replies

Is Freshbot now Deepbot?

The line is getting drawn ever thinner

         

trillianjedi

4:18 pm on May 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I've seen several postings about this now in the last few days, although this is my first actual experience of it.

I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).

It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.

In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.

I'm interested in hearing from others who are seeing the same.

TJ

Stefan

11:36 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



[quote]the last deepbot crawl data can be used for cross-verification. It's also there as a worst-case back-up, but I don't think we'll need to use it.[/quote'

Good stuff GG. I'm interpreting that as either 64.68 or 216.239 doing a deepcrawl of some sort soon, then showing up in the next update. The light at the end of the tunnel is just around the bend.

GoogleGuy

11:43 pm on May 23, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Oaf357, some people have plotted this out pretty carefully, but we're also cautious enough to keep a back-up that we can switch to as a safety net. That's just good preparation, not something to worry about.

Dolemite

11:50 pm on May 23, 2003 (gmt 0)

10+ Year Member



Ok, so now we have got newer data being "gradually" brought in and, wait till the next update "Let me clarify. The next update should bring in more backlinks, data, etc. Those dang prepositions."
Can it be both of these?

This has me confused as well. In my mind the addition of new backlinks, the lack of which is big problem with the current index, are either brought in "gradually over time" or in the next update. Unless it happens gradually during the next update...?

GoogleGuy,

I hate to be critical, we all appreciate your presence here, but I can't help thinking we'd all be better off if you stated your responses clearly and specifically once rather than saying the same thing obscurely eight times.

So many people take your word as gospel, and I feel like I'm reading the King James version. ;)

jojojo

11:57 pm on May 23, 2003 (gmt 0)

10+ Year Member



"Let me clarify. The next update should bring in more backlinks, data, etc. Those dang prepositions. :) "

Exactly... there is no gradual anything.

Basically we skipped an update while gogole played around with some stuff. End of story. Better bust out the cases of scotch cuz you'll be drinking for another 2-3 weeks.

Oaf357

11:57 pm on May 23, 2003 (gmt 0)

10+ Year Member



Oaf357, some people have plotted this out pretty carefully, but we're also cautious enough to keep a back-up that we can switch to as a safety net. That's just good preparation, not something to worry about.

I totally agree. Maybe my line of work has something to do with it but whenever we have to go to a back up plan, it's not good, at all.

GoogleGuy

12:01 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



jojojo, some data will be brought in, such as spam filters. A larger set of data will be brought in with the next index.

parabola

12:10 am on May 24, 2003 (gmt 0)

10+ Year Member



2-3 weeks seems pretty optimistic jojo since most uodates take at least 4 weeks...

Stefan

12:11 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



My take on it

Right now, for the SERP's, what you see is basically what you get. The algo will have other parameters introduced before the next update that will alter things slightly. A true deepcrawl will begin soon and replace the ancient data currently in the Google database, during the next update, although some freshbot changes can be expected sooner. Normalcy, such as it is, is anywhere from 3 to 7 weeks away. A sudden appearance of missing serp's, pages, and PR isn't going to happen in the next few days or for probably much longer but hope springs eternal.

dvduval

12:12 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Other than fewer backlinks showing and the data being spread across the 9 datacenters, what makes this latest update different than previous updates?

Also, between now and the next regular indexing, what might be different than the status quo?

steveb

12:22 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"I would expect at least another update of the form where the crawl/index cycle finishes and then data centers are updated in the traditional dance."

Being kneedeep in trash makes me feel like being non-cryptic, so...

Ths trash results will stay till about July 1st, at which point an update based on ongoing freshcrawl data will occur.

Does this mean that Google is simply incapable of deleting uk.co URLs until July?

Switching to a new system is one thing.
Accepting horribly degraded results for two months is one thing.
Basing results on a deepcrawl from months ago is one thing.

But Google Guy, for heavens sake why can't the largest, most important search engine on the planet delete/ignore a TLD that no longer exists?

((It is one thing for Google to rank gobs of spam ahead of you. It's pretty humiliating for Google to rank a site that can't possibly exist ahead of you.))

steveb

12:27 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"Other than fewer backlinks showing and the data being spread across the 9 datacenters, what makes this latest update different than previous updates?"

LOL, well for starters most data wasn't updated, it was rolled back.

The results just changed, they weren't updated in any sense of that word. It is like we were all watching The Empire Strikes Back when suddenly the theater owner switched us to the middle of Stars Wars... while promising Return of the Jedi will appear at some point.

jojojo

12:29 am on May 24, 2003 (gmt 0)

10+ Year Member



"Hate to be so persistent but, is this newer data being picked up now or is it going to be picked up sometime before the next update?"

Now it's not. No it won't. This update is over. Next one will start 10th of July or so. This update was not really an update - if you considering updating with the data from the previous month.

Nothing new has changed or happened to the process yet.

GoogleGuy

12:30 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



steveb, I'm checking out your dominic report now--I'll investigate the uk.co tonight.

dvduval

12:33 am on May 24, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The results just changed, they weren't updated in any sense of that word. It is like we were all watching The Empire Strikes Back when suddenly the theater owner switched us to the middle of Stars Wars... while promising Return of the Jedi will appear at some point.

That's what I meant to say, but in a subtle way. You could also say that Star Wars 7,8 and 9 have been announced, but first we are going to start over with Star Wars!

Let me try again:
What, if anything, is POSITIVE about the latest update?
And, what POSITIVE things might we expect that are different from the status quo between now and the next update?

TheAutarch

12:40 am on May 24, 2003 (gmt 0)

10+ Year Member



Now it's not. No it won't. This update is over. Next one will start 10th of July or so. This update was not really an update - if you considering updating with the data from the previous month.

Nothing new has changed or happened to the process yet.

I know there is not going to be much change in the way of updated SERPS.

Maybe I should have been more clear. When I said new data, I meant a crawl and was just trying to find out if there was going to be an official deep crawl of some sort between now and July. GoogleGuy said something about using newer data than the April crawl and that would imply picking up some between now and the next update. What I initially was trying to find out is if it's really already started, which is probably very redundant and annoying since that's what this topic is all about.

This 211 message thread spans 15 pages: 211