Google freshbot is not fresh anymore

is google freshgot dead?

[darkroom]

HI guys..for the past 2-3 weeks i have seen that google freshbot is not very active...before it used to visit my site everyday..but now it doesn't...in fact ..it now shows all the old cache for my web site..does anybody know y?

[Stefan]

The freshbot activity dropped off just before the last indexing at the start of 2003. It's started getting busy again over the last few days, (looked at about 70% of my site every day the last 3 days), but isn't showing the tags although the cache is freshed. I bet it gets a lot more active as we go through the next week. Don't lose hope yet, Darkroom, it might be back soon.

An interesting thing is that the deep crawl bot (216.239.x.x), and the freshbot (64.68.x.x), were both dropping by last night. I don't know what that's all about.

[edited by: Stefan at 12:06 am (utc) on Jan. 13, 2003]

[troels nybo nielsen]

Funny.. I've seen exactly the same. I wonder if freshbot and deepcrawler are getting their roles somehow intermingled? We know that Google are experimenting with freshbot. At least it's good to see that freshbot's reluctance to do a lot of crawling is not my own special problem but is seen elsewhere too. I think I've been crawled about half as much by freshbot this month as I were at the same time in december. And very, very few fresh tags.

[Stefan]

Yeah troels, I've noticed from posts that the freshbot activity seems to be similar on our sites. I figure it's a testbed. There's something about certain sites that it likes, and uses, to experiment on. I've read some theories here that don't seem to match what happens with me; it might be that the thing is totally unpredictable cause the fresh algo is always fluxing.

[mayor]

I've seen the deepcrawlers out past their curfew so it stands to reason some freshbot hats have to be left hanging in the closet.

[larsj]

I have noticed that the freshbot includes NEW pages directly in the index, with no fresh tag, and they stays there! Great!

Can it be that the freshbot are more smart and now instantly adds without 'dance'?

[Stefan]

Maybe the freshbot is showing us the smartest, newest version of the Google algo. Just speculating, of course.

64.68.82.x is working its way through my site right now. It started at 0:20 UTC and is still dropping by and getting one or two pages at a time.
I really don't know why the 216.239.x.x come through my site earlier and grabbed 7 pages if the other one is out and about. The whole site was crawled by it early Jan.

[yankee]

Once the deep crawl finishes (should be soon), the freshbot activity will pick up again. Probably hard to do both full steam at the same time (resource limitations?).

[Tropical Island]

We uploaded a new page to one of our sites early last week with a link to it from the index page and also put a link to it on the front page of a related site a few days later. The page with the link on the 2nd site is now showing #1 for related search terms but not the actual page. Very strange.

[mfishy]

Yes, the fresh tags have been infrequent this month.

One nice thing is that when I had a new sit eit gets immediately picked up by Google and can rank well.