Forum Moderators: open

Message Too Old, No Replies

When does deep crawling begin?

         

Roscoe

11:59 am on Mar 7, 2003 (gmt 0)

10+ Year Member



Firstly - good look everyone with the update;)

I'm trying to work out when 'deep crawling starts', the reason I'm asking is because usually I get deep crawled after the dance, however my logs show that all 1800 of my pages have been crawled by googlebot 64.68.*.* - between the 2nd and 5th of march? I've never seen the freshbot look at all my pages, it's usually only ten or so of my main pages?

Have I been deep crawled already? or was this just my mate freshy.

AthlonInside

12:20 pm on Mar 7, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



deep crawl has not started yet but it is for sure to start in the next few days.

Fresh crawl has nothing related to predict Deep crawl. Since both works alone.

Roscoe

12:24 pm on Mar 7, 2003 (gmt 0)

10+ Year Member



Does this mean that the freshbot looked at all 1800 of my pages? - just before the dance? That seams odd to me, especially that things are now changing?

giggle

12:26 pm on Mar 7, 2003 (gmt 0)

10+ Year Member



GoogleGuy said that there would be a deep crawl after the update is complete.

NickCoons

1:34 pm on Mar 7, 2003 (gmt 0)

10+ Year Member



Roscoe,

A lot of people have been reporting the same type of behavior from Freshbot over the past month.

Alternative Future

8:34 pm on Mar 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi Roscoe,

I had a visit from FreshBot 64.*.*.* on the 7th March it also trawled over 800+ pages on my site!

So yeah looks as though the FreshBot is the guilty party...

KR,

George

borad

11:35 pm on Mar 9, 2003 (gmt 0)

10+ Year Member



Freshbot has been dropping by and acting like a limited deepcrawler for the past several weeks on my site (a couple pages are PR 5, most of the hundred pages are 3).

I dunno if I've passed some kind of threshhold, or whether the distinction between fresh and deep bots is breaking down.

(My site is pretty static.)