Welcome to WebmasterWorld Guest from 54.196.214.35

Forum Moderators: open

Message Too Old, No Replies

DeepBot is here now?

     
8:48 am on Apr 28, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 18, 2002
posts:143
votes: 0


I see DeepBot crawling my pages....

What's up?

9:05 am on Apr 28, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Nov 27, 2002
posts:927
votes: 0


64. or 216.?

I have 64s crawling (freshbot) but no 216s (deepbot).

9:08 am on Apr 28, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Oct 18, 2002
posts:143
votes: 0


Time: 26/04/2003 12.37.57
IP: 216.239.46.133

Time: 26/04/2003 13.25.30
IP: 216.239.46.75

Strange, isn't it?

9:27 am on Apr 28, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Feb 18, 2003
posts:128
votes: 0


I have a prediction as to what is going on. Feel free to write me off as a newbie and not read on.

There are three things that I have noticed with google recently that suggest they are about to move (or at least trial) to continuous PR and link updates similiar to the way freshbot works.

1. People are commenting freshbot is, on occasions, acting more like deepbot. The extra depth and amount of hits in a period of time is the strange activity of freshbot.

2. There was in incedent at www-sj.google.com in which every site was restricted to a maximum of 1000 incoming links. If this was the case the top 1000 links would provide a good indication of the sites "true" PR if they moved to progressive updating, and not require massive calculations.

3. Many complaints here and elsewhere that the lack of continuous updates means slow indexing of new content with it's true PR.

Anyway, I could just be way off.

10:51 am on Apr 28, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Apr 28, 2003
posts:109
votes: 0


still in testing phase I suppose.

Freshbot has listed new links to my site from other sites above the actual site.

It gives the site a lot of exposure, so I am not complaining. I am sure though it is not what users expect...

4:00 pm on Apr 28, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Nov 28, 2002
posts:70
votes: 0


joker, those log entries were from two days ago.
4:06 pm on Apr 28, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:June 15, 2002
posts:396
votes: 0


Must be jetlag:)

teeceo.

2:48 am on Apr 29, 2003 (gmt 0)

New User

10+ Year Member

joined:Feb 7, 2003
posts:10
votes: 0


Yeah, I had about 10k hits from deepbot (216....)
to one of my sites. Quite surpised.
4:25 am on Apr 29, 2003 (gmt 0)

Preferred Member

10+ Year Member

joined:May 14, 2002
posts:378
votes: 0


The 216 bot crawled on our sites continuously from 4/15 until 4/26. You're probably seeing the tail end of the deep crawl.
5:37 am on Apr 29, 2003 (gmt 0)

Junior Member

10+ Year Member

joined:Jan 4, 2003
posts:106
votes: 0


I noticed today while doing a search that some of my deep pages that have not been updated in more than two years had fresh dates in the SERP's.

The problem is that I have no access to raw server logs so have no idea if I'm being visited by 64. or 216.

All I get is a top ten user agents report that always says Googlebot 2.1 every day.

5:42 am on Apr 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 27, 2001
posts:784
votes: 0


Yep, one of my sites got a complete pull a few days ago, following up the spidering two weeks ago.

$ zgrep -c 216.239.46 BLAH


20030401 to 20030412: 0
20030413: 0
20030414: 0
20030415: 1090
20030416: 26
20030417: 9
20030418: 5
20030419: 10
20030420: 15
20030421: 28
20030422: 35
20030423: 5
20030424: 2
20030425: 0
20030426: 874
20030427: 0
20030428: 0
5:53 am on Apr 29, 2003 (gmt 0)

Full Member

10+ Year Member

joined:Aug 26, 2001
posts:277
votes: 0


borisbaloney

Interesting, but i hope any continuous PR does not cut off the less than 4 PR URLs, I have a large amount of less than 4 PR links that account for most of my SERPs. I have always enjoyed getting ratings without the reasons being easy to determine. The listing is there like a jedi warrior, may the force be with you.

Anyway i feel something is up.

6:03 am on Apr 29, 2003 (gmt 0)

Senior Member

WebmasterWorld Senior Member powdork is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Sept 13, 2002
posts:3346
votes: 0


I'm with you wasmith. I love it when people wonder how I rank better with nowhere near as many backlinks. Great way to hide anchor text too. Its also why I use ATW to check out the competition.