Forum Moderators: goodroi
I am afraid that because my pages are so long that I am missing the boat regarding getting all of my content spidered.
Currently the page is getting crawled by normal rate.
When I saw the "time spent downloading a page" I became concerned.
Number of pages crawled per day
Maximum 6
Average 2
Number of kilobytes downloaded per day
Maximum 387
Average 96
Minimum 0
Time spent downloading a page (in milliseconds)
Maximum 3511
Average 375
Minimum 0
Do I have a problem? Is it a non-issue - I am thinking that all of the pages will get spidered just that it will take a montnh f or a complete crawl as opposed to 12 days. Please help me :)