DeepBot is here now?

[joker197cinque]

I see DeepBot crawling my pages....

What's up?

[John_Caius]

64. or 216.?

I have 64s crawling (freshbot) but no 216s (deepbot).

[joker197cinque]

Time: 26/04/2003 12.37.57
IP: 216.239.46.133

Time: 26/04/2003 13.25.30
IP: 216.239.46.75

Strange, isn't it?

[borisbaloney]

I have a prediction as to what is going on. Feel free to write me off as a newbie and not read on.

There are three things that I have noticed with google recently that suggest they are about to move (or at least trial) to continuous PR and link updates similiar to the way freshbot works.

1. People are commenting freshbot is, on occasions, acting more like deepbot. The extra depth and amount of hits in a period of time is the strange activity of freshbot.

2. There was in incedent at www-sj.google.com in which every site was restricted to a maximum of 1000 incoming links. If this was the case the top 1000 links would provide a good indication of the sites "true" PR if they moved to progressive updating, and not require massive calculations.

3. Many complaints here and elsewhere that the lack of continuous updates means slow indexing of new content with it's true PR.

Anyway, I could just be way off.

[amazed]

still in testing phase I suppose.

Freshbot has listed new links to my site from other sites above the actual site.

It gives the site a lot of exposure, so I am not complaining. I am sure though it is not what users expect...

[speda1]

joker, those log entries were from two days ago.

[teeceo]

Must be jetlag:)

teeceo.

[wired4fun]

Yeah, I had about 10k hits from deepbot (216....)
to one of my sites. Quite surpised.

[fiestagirl]

The 216 bot crawled on our sites continuously from 4/15 until 4/26. You're probably seeing the tail end of the deep crawl.

[aroach]

I noticed today while doing a search that some of my deep pages that have not been updated in more than two years had fresh dates in the SERP's.

The problem is that I have no access to raw server logs so have no idea if I'm being visited by 64. or 216.

All I get is a top ten user agents report that always says Googlebot 2.1 every day.

[danny]

Yep, one of my sites got a complete pull a few days ago, following up the spidering two weeks ago.

$ zgrep -c 216.239.46 BLAH

20030401 to 20030412: 0 
20030413: 0 
20030414: 0 
20030415: 1090 
20030416: 26 
20030417: 9 
20030418: 5 
20030419: 10 
20030420: 15 
20030421: 28 
20030422: 35 
20030423: 5 
20030424: 2 
20030425: 0 
20030426: 874 
20030427: 0 
20030428: 0 

[wasmith]

borisbaloney

Interesting, but i hope any continuous PR does not cut off the less than 4 PR URLs, I have a large amount of less than 4 PR links that account for most of my SERPs. I have always enjoyed getting ratings without the reasons being easy to determine. The listing is there like a jedi warrior, may the force be with you.

Anyway i feel something is up.

[Powdork]

I'm with you wasmith. I love it when people wonder how I rank better with nowhere near as many backlinks. Great way to hide anchor text too. Its also why I use ATW to check out the competition.