Welcome to WebmasterWorld Guest from 188.8.131.52
Forum Moderators: goodroi
I am afraid that because my pages are so long that I am missing the boat regarding getting all of my content spidered.
Currently the page is getting crawled by normal rate.
When I saw the "time spent downloading a page" I became concerned.
Number of pages crawled per day
Number of kilobytes downloaded per day
Time spent downloading a page (in milliseconds)
Do I have a problem? Is it a non-issue - I am thinking that all of the pages will get spidered just that it will take a montnh f or a complete crawl as opposed to 12 days. Please help me :)