Forum Moderators: open
When the deepcrawl started I decided to see how far into the deepcrawl I could go adding new files and get them crawled. It looks like you got two days to get atleast the new section index crawled and maybe a few files crawled, and a little more than a day to get all the files added.
First sign of deepcrawl: - / - 03/10/03 20:51:29 PST 632 files
On 3/11 11:00 AM, I create /new_section_1/ with 27 files. Get's all files.
On 3/11 12:00PM, I create /new_section_2/ with 38 files. Get's all files!
On 3/11 2:56 PM, I create /new_section_3/ with 39 files. Get's all files!
On 3/11 4:37 PM, I create /new_section_4/ with 40 files. Get's all files!
On 3/12 7:00 PM, I create /new_section_5/ with 40 files. Get's eight files.
Deepcrawl has got index on 3/10, then 3/11, and then 3/12.
On 3/12 7:00 PM, I create /new_section_6/ with 40 files. Get's the index.
Last day of main deepcrawl activity, 3/14. One file hit on 3/15.
Now to another domain. 847 files
3/14, at 2:52 PM I add 64 files to section on domain2. Get's nothing.
3/14, at 6:50 PM I add 86 files to section_2 on domain2. Get's nothing.
3/15, at 4:09 PM I add 101 files to section_3 on domain2. Get's nothing.
3/15, at 8:25 PM, I create new_section_1 on domain2. Get's nothing.
Last day of deepcrawl activity, 3/14.
So when the deepcrawl first knocks, spend the next day geting every thing up that you missed, or havn't done yet, instead of panicing! If your site is much bigger, you might have a few more days to make changes, my two big sites had deepcrawl activity until early this morning, 3/18.
