Forum Moderators: open

Message Too Old, No Replies

FreshBot or DeepCrawl?

Can you tell?

         

xlcus

10:23 am on Dec 5, 2002 (gmt 0)

10+ Year Member



My site is being crawled by Google at the moment, but I'm curious to know if it's a DeepCrawl or just the FreshBot. Is there any way to tell?

Some of the pages have already appeared in Google (with dates next to them) which makes me think it's the FreshBot.

If that's true, will I miss out on the DeepCrawl this month? Has the DeepCrawl for next month's index started yet?

Nick_W

10:30 am on Dec 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



OTOH

Freshbot 64.*
DeepCrawl 216.*

Nick

xlcus

10:36 am on Dec 5, 2002 (gmt 0)

10+ Year Member



Thanks Nick. Looks like I'm being crawled by both. :-)

seindal

11:09 am on Dec 5, 2002 (gmt 0)

10+ Year Member



I think they are working at the same time, but they also have differently tasks, so there is no conflict. The deepcrawl is working on the next index, for january. The freshbot is dynamically updating the current december index.

I see little reason why the freshbot should't start just after the dance, when the new index is installed.

René.

troels nybo nielsen

12:01 pm on Dec 5, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Welcome to WebmasterWorld, xlcus.

One of the wonderful tools here is the sitesearch. Right now it will show you 133 documents about freshbot and a few about deepcrawl as well. Good reading!