Welcome to WebmasterWorld Guest from 3.227.233.78

Forum Moderators: open

Message Too Old, No Replies

Is Freshbot now Deepbot?

The line is getting drawn ever thinner

     
4:18 pm on May 22, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member trillianjedi is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Apr 15, 2003
posts:7256
votes: 3


I've seen several postings about this now in the last few days, although this is my first actual experience of it.

I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).

It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.

In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.

I'm interested in hearing from others who are seeing the same.

TJ

11:36 pm on May 23, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


[quote]the last deepbot crawl data can be used for cross-verification. It's also there as a worst-case back-up, but I don't think we'll need to use it.[/quote'

Good stuff GG. I'm interpreting that as either 64.68 or 216.239 doing a deepcrawl of some sort soon, then showing up in the next update. The light at the end of the tunnel is just around the bend.

11:43 pm on May 23, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


Oaf357, some people have plotted this out pretty carefully, but we're also cautious enough to keep a back-up that we can switch to as a safety net. That's just good preparation, not something to worry about.
11:50 pm on May 23, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 20, 2003
posts:390
votes: 0


Ok, so now we have got newer data being "gradually" brought in and, wait till the next update "Let me clarify. The next update should bring in more backlinks, data, etc. Those dang prepositions."
Can it be both of these?

This has me confused as well. In my mind the addition of new backlinks, the lack of which is big problem with the current index, are either brought in "gradually over time" or in the next update. Unless it happens gradually during the next update...?

GoogleGuy,

I hate to be critical, we all appreciate your presence here, but I can't help thinking we'd all be better off if you stated your responses clearly and specifically once rather than saying the same thing obscurely eight times.

So many people take your word as gospel, and I feel like I'm reading the King James version. ;)

11:57 pm on May 23, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 19, 2003
posts:125
votes: 0


"Let me clarify. The next update should bring in more backlinks, data, etc. Those dang prepositions. :) "

Exactly... there is no gradual anything.

Basically we skipped an update while gogole played around with some stuff. End of story. Better bust out the cases of scotch cuz you'll be drinking for another 2-3 weeks.

11:57 pm on May 23, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:Mar 5, 2003
posts:636
votes: 0


Oaf357, some people have plotted this out pretty carefully, but we're also cautious enough to keep a back-up that we can switch to as a safety net. That's just good preparation, not something to worry about.

I totally agree. Maybe my line of work has something to do with it but whenever we have to go to a back up plan, it's not good, at all.

12:01 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


jojojo, some data will be brought in, such as spam filters. A larger set of data will be brought in with the next index.
12:10 am on May 24, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:May 8, 2003
posts:103
votes: 0


2-3 weeks seems pretty optimistic jojo since most uodates take at least 4 weeks...
12:11 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 4, 2002
posts:1687
votes: 0


My take on it

Right now, for the SERP's, what you see is basically what you get. The algo will have other parameters introduced before the next update that will alter things slightly. A true deepcrawl will begin soon and replace the ancient data currently in the Google database, during the next update, although some freshbot changes can be expected sooner. Normalcy, such as it is, is anywhere from 3 to 7 weeks away. A sudden appearance of missing serp's, pages, and PR isn't going to happen in the next few days or for probably much longer but hope springs eternal.

12:12 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 28, 2001
posts:1380
votes: 0


Other than fewer backlinks showing and the data being spread across the 9 datacenters, what makes this latest update different than previous updates?

Also, between now and the next regular indexing, what might be different than the status quo?

12:22 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 20, 2002
posts:4652
votes: 0


"I would expect at least another update of the form where the crawl/index cycle finishes and then data centers are updated in the traditional dance."

Being kneedeep in trash makes me feel like being non-cryptic, so...

Ths trash results will stay till about July 1st, at which point an update based on ongoing freshcrawl data will occur.

Does this mean that Google is simply incapable of deleting uk.co URLs until July?

Switching to a new system is one thing.
Accepting horribly degraded results for two months is one thing.
Basing results on a deepcrawl from months ago is one thing.

But Google Guy, for heavens sake why can't the largest, most important search engine on the planet delete/ignore a TLD that no longer exists?

((It is one thing for Google to rank gobs of spam ahead of you. It's pretty humiliating for Google to rank a site that can't possibly exist ahead of you.))

12:27 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member steveb is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:June 20, 2002
posts:4652
votes: 0


"Other than fewer backlinks showing and the data being spread across the 9 datacenters, what makes this latest update different than previous updates?"

LOL, well for starters most data wasn't updated, it was rolled back.

The results just changed, they weren't updated in any sense of that word. It is like we were all watching The Empire Strikes Back when suddenly the theater owner switched us to the middle of Stars Wars... while promising Return of the Jedi will appear at some point.

12:29 am on May 24, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Mar 19, 2003
posts:125
votes: 0


"Hate to be so persistent but, is this newer data being picked up now or is it going to be picked up sometime before the next update?"

Now it's not. No it won't. This update is over. Next one will start 10th of July or so. This update was not really an update - if you considering updating with the data from the previous month.

Nothing new has changed or happened to the process yet.

12:30 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 8, 2001
posts:2882
votes: 0


steveb, I'm checking out your dominic report now--I'll investigate the uk.co tonight.
12:33 am on May 24, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Sept 28, 2001
posts:1380
votes: 0


The results just changed, they weren't updated in any sense of that word. It is like we were all watching The Empire Strikes Back when suddenly the theater owner switched us to the middle of Stars Wars... while promising Return of the Jedi will appear at some point.

That's what I meant to say, but in a subtle way. You could also say that Star Wars 7,8 and 9 have been announced, but first we are going to start over with Star Wars!

Let me try again:
What, if anything, is POSITIVE about the latest update?
And, what POSITIVE things might we expect that are different from the status quo between now and the next update?

12:40 am on May 24, 2003 (gmt 0)

New User

10+ Year Member

joined:Apr 25, 2003
posts:21
votes: 0


Now it's not. No it won't. This update is over. Next one will start 10th of July or so. This update was not really an update - if you considering updating with the data from the previous month.

Nothing new has changed or happened to the process yet.

I know there is not going to be much change in the way of updated SERPS.

Maybe I should have been more clear. When I said new data, I meant a crawl and was just trying to find out if there was going to be an official deep crawl of some sort between now and July. GoogleGuy said something about using newer data than the April crawl and that would imply picking up some between now and the next update. What I initially was trying to find out is if it's really already started, which is probably very redundant and annoying since that's what this topic is all about.

This 211 message thread spans 15 pages: 211