Deepbot is Sloooooow

Or is it just me?

[Critter]

I have a PR3 (boo, hisssss) site that deepbot's in right now, but it only seems to be getting a page every 5-7 minutes on average. Last month I was brand new for deepbot and saw it running much faster.

Anyone else noticed this?

Peter

[BGumble]

Same here. Started slow.. bursted yesterday morning with the normal amount.. now he's totally absent. This is on a fairly chunky PR7. Much less activity than last month, perhaps it will just take longer. I'm sure they won't move ahead without a full crawl.

[JLindsay]

I was actually going to post a related question. We saw the deepcrawl earlier this week, however it only picked up 100 of our pages. (We have about 150 pages in all on a site with PR6.) No sign of it since. Usually it comes over several days and there is quite heavy activity. Very strange. I am glad to hear others are seeing the same. I have just been assuming that it will be coming back for a supplementary crawl in a week to ten days time, as seems usual, and will pick up everything then.

[deadboy]

same story here as well, it's taking deepbot 4 minutes to crawl a page
it'll need more than 10 years for it to crawl all the pages on my site at this rate =(

[Oaf357]

I've noticed a slower Deepbot too.

Maybe it's got spring fever or something and is focused on other things.

But another thing I noticed this time is Freshbot and Deepbot crawling at the exact same time. Maybe Freshbot will play a small role in this update.

Who knows?

[wired4fun]

For my client site, deepbot grabbed
20k pages on day 1, then 50k on day 2,
then 50k on day 3, and then 20k on day 4,
and so far today, has only grabbed about
40 pages total. Similar pattern whether
the site is a pr7 or pr8.

Wired.

[deejay]

I'm just happy to see it's still out working. It took my estabished sites (PR4) early in the piece, but it hasn't made it to my new site at all yet.

1500 pages with another 3000 to go up next month. I really don't want to miss this crawl and have to wait another month... flippin' nervewracking.

[Critter]

Hmmm, he seems to be goin' faster now :) Guess he just needed a little melonaide.

Ow, ooch, ack

Peter

[SEO practioner]

The reason for the slow speed is because DeepBot male has spring fever and is seeking DeepBot female...

:-) SEO

[Critter]

Well he must have found his female, because he's all happy now...has been pounding me for 48 hours now...

I take it all back. :P~

Peter

[markusf]

Guess we can take this as a sign the deep crawl is nearly over...

[born2drv]

Googleguy mentioned some tougher link popularity traps this time around...

Maybe it's taking deepbot considerably longer to crawl your websites because it's recording and logging all the spam? ;) (j/k)

[Critter]

Ach! You rotten thing :)

I...don't...spam :P

Peter

[farside847]

is the deepcrawl over? I saw 5k hits a day for the last 8 days, today I have seen none...

[Critter]

Crawl's still on...steady hits here.

Peter