homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

DeepBot is here now?

 8:48 am on Apr 28, 2003 (gmt 0)

I see DeepBot crawling my pages....

What's up?



 9:05 am on Apr 28, 2003 (gmt 0)

64. or 216.?

I have 64s crawling (freshbot) but no 216s (deepbot).


 9:08 am on Apr 28, 2003 (gmt 0)

Time: 26/04/2003 12.37.57

Time: 26/04/2003 13.25.30

Strange, isn't it?


 9:27 am on Apr 28, 2003 (gmt 0)

I have a prediction as to what is going on. Feel free to write me off as a newbie and not read on.

There are three things that I have noticed with google recently that suggest they are about to move (or at least trial) to continuous PR and link updates similiar to the way freshbot works.

1. People are commenting freshbot is, on occasions, acting more like deepbot. The extra depth and amount of hits in a period of time is the strange activity of freshbot.

2. There was in incedent at www-sj.google.com in which every site was restricted to a maximum of 1000 incoming links. If this was the case the top 1000 links would provide a good indication of the sites "true" PR if they moved to progressive updating, and not require massive calculations.

3. Many complaints here and elsewhere that the lack of continuous updates means slow indexing of new content with it's true PR.

Anyway, I could just be way off.


 10:51 am on Apr 28, 2003 (gmt 0)

still in testing phase I suppose.

Freshbot has listed new links to my site from other sites above the actual site.

It gives the site a lot of exposure, so I am not complaining. I am sure though it is not what users expect...


 4:00 pm on Apr 28, 2003 (gmt 0)

joker, those log entries were from two days ago.


 4:06 pm on Apr 28, 2003 (gmt 0)

Must be jetlag:)



 2:48 am on Apr 29, 2003 (gmt 0)

Yeah, I had about 10k hits from deepbot (216....)
to one of my sites. Quite surpised.


 4:25 am on Apr 29, 2003 (gmt 0)

The 216 bot crawled on our sites continuously from 4/15 until 4/26. You're probably seeing the tail end of the deep crawl.


 5:37 am on Apr 29, 2003 (gmt 0)

I noticed today while doing a search that some of my deep pages that have not been updated in more than two years had fresh dates in the SERP's.

The problem is that I have no access to raw server logs so have no idea if I'm being visited by 64. or 216.

All I get is a top ten user agents report that always says Googlebot 2.1 every day.


 5:42 am on Apr 29, 2003 (gmt 0)

Yep, one of my sites got a complete pull a few days ago, following up the spidering two weeks ago.

$ zgrep -c 216.239.46 BLAH

20030401 to 20030412: 0
20030413: 0
20030414: 0
20030415: 1090
20030416: 26
20030417: 9
20030418: 5
20030419: 10
20030420: 15
20030421: 28
20030422: 35
20030423: 5
20030424: 2
20030425: 0
20030426: 874
20030427: 0
20030428: 0


 5:53 am on Apr 29, 2003 (gmt 0)


Interesting, but i hope any continuous PR does not cut off the less than 4 PR URLs, I have a large amount of less than 4 PR links that account for most of my SERPs. I have always enjoyed getting ratings without the reasons being easy to determine. The listing is there like a jedi warrior, may the force be with you.

Anyway i feel something is up.


 6:03 am on Apr 29, 2003 (gmt 0)

I'm with you wasmith. I love it when people wonder how I rank better with nowhere near as many backlinks. Great way to hide anchor text too. Its also why I use ATW to check out the competition.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved