Is Freshbot now Deepbot?

The line is getting drawn ever thinner

[trillianjedi]

I've seen several postings about this now in the last few days, although this is my first actual experience of it.

I'm being hit very hard by google's freshbot at the moment, and going deep too. At first glance at what is currently going on with the little guys, I had to check and double check that the IP's were 64.... (they are).

It's behaviour, in terms of hard hitting and depth of crawl (it's going through the entire site) is more like the character of the old deepbot.

In fact, it's identical behaviour to deepbot the last time it crawled this site back in April.

I'm interested in hearing from others who are seeing the same.

TJ

[entropy]

I'm getting hits to PDF files from freshbot. Is this normal freshbot behaviour? I can't rememeber seeing this before.

[teeceo]

freshbot is cwraling but, no fresh tags on my sites.(these sites are a few months old and got struck down with alot of other sites when googlegonewild made its grand apperents).

teeceo.

[wanderingmind]

I see freshie everyday. new pages crawled, not showing up in index.

Changes I make on the homepage are grabbed and in the index within 2 days.

On another site I have, created 2 months back, while fb/gb has visited it several times, still does not show up in the index. not even the homepage. while ATW has eaten up all pages.

[suggy]

I seeing Freshie a lot too and some pages added.... it seems

This site first got PR4 in April, then PR evaporated during DOM. Presently keeps flipping between showing 153 pages allinurl and 98!

Have been getting traffic from new pages and not finding them listed amongst the 153...

Weird sh1t!

[leifwessman]

I have a brand new website. Googlebot has been spidering it for the last three weeks. I log everything. Currently googlebot has fetched about 60000 pages from my website. But only a few are visible in google. When doing a match on the pages in google and the logs i found a similarity! Only pages that was spidered by googlebot ip 64.68.82.66 are visible in Google!

Can anyone else confirm this?

Leif

[Rugles]

It is the freshbot. Do a site search for "freshbot" and you will find out what is happening.
I can tell that it is normal.

[Perplexed]

You have a NEW site.... and it has 60.000 pages?

[leifwessman]

Rugles, I know it's freshbot. The interesting is that only the pages that are requested from ip 64.68.82.66 (not the other freshbot ips) gets in the index.

Perplexed, Yes, it's dynamic.

Leif

[seofreak]

The "newest" index page of one of my sites has been up in google for 3 to 4 weeks now. But my new internal pages which were updated with the index page show the old result/cache at google. This pattern shows freshbot behaviour, but that should only last for 1 or 2 days .. this has been there for 3 to 4 weeks. Can anybody explain this pattern? Or is this an indication that deepbot is crawling?

[strategies]

Wondering too on Fresh vs Deepbot behavior. My site is regularly crawled (every other day) by freshbots, but none of the pages are added. Cache has been refreshed on some of the main pages, but still have old cache for most of the site. Is this the freshbot doing some freshbot work (refreshing some cache) and otherwise doing deepbot work (just gathering pages for the "next" google index update?

[Pricey]

I'm still only seeing Freshie. No Deep crawl for the last 3-4 months for me. Even so, Freshie is only spidering the odd page here and there. I don't understand why my site gets so little attention, its over 3 years old and new content is added nearly every month. Maybe Google has penalized me for some obscure reason...

[Stefan]

I'm still only seeing Freshie

That's all that's been around for everyone since the April crawl, (except for one post I read by someone saying they had 216.239 around regularly... you had to wonder if they meant 216.39).

Maybe Google has penalized me for some obscure reason...

From reading posts here of people who actually were penalized, it seemed to me that google would continue crawling the site even if it were penalized. I'm not 100% on that, but the reasons for freshie not visiting often might be related more to your incoming links, PR etc.

No Deep crawl for the last 3-4 months for me

That seems odd... you should have had at least two deepcrawls in that time.

[Stefan]

Pricey, you show only 4 backlinks, one from your own site,(grey-barred), one DMOZ, (cat is PR5 but with a lot of links on it), one Google directory, (PR4), and a linking firm that I can't quite figure out...

You need more incoming links and to be sure of what that link company is doing.

Added: you might consider shortening the title somewhat, though I doubt that that is your problem.

[GoogleGuy]

Hey, I think that a lot of people have noticed that freshbot is crawling deeper into websites where the deepbot used to explore.

[Dolemite]

Hint, hint...