FreshDeepBot in da house

just saw it...

[Critter]

Anyone else getting crawled by FreshDeep?

Peter

[decstar]

Googlebot on these IPs has been crawling the internal pages of my site for the first time, these pages have been around for about two weeks and are only linked to from other internal pages on my site that were crawled for the first time today.
I am presuming that this is the DeepFreshBot that someone mentioned in the last few days.

<edit>
updated list of IPs I have seen
64.68.82.12
64.68.82.16
64.68.82.25
64.68.82.25
64.68.82.26
64.68.82.27
64.68.82.30
64.68.82.32
64.68.82.33
64.68.82.34
64.68.82.36
64.68.82.41
64.68.82.45
64.68.82.51
64.68.82.52
64.68.82.55
64.68.82.56
64.68.82.68
64.68.82.68
64.68.82.70
64.68.82.71
64.68.82.79
</edit>

Decstar

[edited by: decstar at 6:16 pm (utc) on June 18, 2003]

[farside847]

googlebot has been busy today. I have seen 11,000+ hits
so far today. Normally freshie gets about 3000 a day, this
looks to be a deepfreshbot. Anyone else seeing this?

[olias]

Yeah, I have been seeing googlebot activity all day, but for me it is behaving more like freshbot than deepbot on most of my sites. Not seen it head over to one of my newer sites yet which is what I am really waiting to see.

[jones111]

Definitly freshdeep here. Got 9.000 pages compare to around 3000 normaly.

[jackobar]

I have entrys in my logfile from
216-239-45-4.google.com
I have been trying for weeks to get on google,
(i added hyperlinks from my other sites to my newsite to attract the googlebot)
does a vist from 216-239-45-4.google.com
mean i have finally succeeded>

[Marcia]

Here's something on that one:

[webmasterworld.com...]
[webmasterworld.com...]

[nuhkweb]

Hi,

I am very pleased to have about 100 pages in -fi with a reasonable position.
As this is a new site that's been uploaded end of May, until now, Freshbot found the some pages, they appeared in Google for 2 a 3 days and then disappeared completely for 6 a 10 days untill freshbot found them again.

My index page and some other are daily updated with news lines.

So now I am scared that when Freshbot scans those pages again, they will get a date tag but then disappear after 2 days.

Or is it so that once in the index (Esmerada), even when Freshbot re-visits, pages hold their position.

Greetings

[sanuk]

Hi,

I suppose after you are in the main index that Freshbot doesn't visit the page so much, only very new pages.

Regards,

[Seattle_SEM]

Well, I guess we'll learn very shortly what the new update model will be.

I can't imagine that a traditional deep crawl would be happening while they're in the middle of an update?

This must be a new model..

[g1smd]

For a site newly online at the end of March Googlebot sniffed around every 2 or 3 days or so.

To begin with, the usual pattern was something like: the site was in the index with fresh tags for a day or so, then lost the fresh tag for part of a day, then dropped out of the listings for a day or two. If the site had changed in someway freshbot would pick it up and relist it again for a day or two.

After mid-April, the site mainly stayed in the index with fresh tags, for a day or so, then reamined in for several more days without fresh tags, until a new fresh tag was added again. There were a couple of occasions where the site dropped out for about 5 days, and a few occasions where the site plumetted by about 60 positions for a day or two.

However, the point is, fresh listings don't quite behave as they used to. They seem more sticky after initial listing.

[mfishy]

<<I can't imagine that a traditional deep crawl would be happening while they're in the middle of an update?>>

Seems to be acting like normal freshie to me.

It seems strange that they are crawling mid update though.

[LukasS]

Well i got sites for two days online and i see loots of google deepfreshie and suprisingly inktomi :).

Hope it gets to index soon.

[Stefan]

There were freshbot visits during Cassandra. 64.68 has been pretty busy for weeks now, going fairly deep. This might be more of the same.

[markus007]

I thought the old deep bot was gone? I just found this in my logs...

216.239.45.4 Googlebot/2.1 (+http://www.googlebot.com/bot.html) 2003-06-16 20:28:53.077