Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: goodroi
I am afraid that because my pages are so long that I am missing the boat regarding getting all of my content spidered.
Currently the page is getting crawled by normal rate.
When I saw the "time spent downloading a page" I became concerned.
Number of pages crawled per day
Number of kilobytes downloaded per day
Time spent downloading a page (in milliseconds)
Do I have a problem? Is it a non-issue - I am thinking that all of the pages will get spidered just that it will take a montnh f or a complete crawl as opposed to 12 days. Please help me :)
Look at the graph, have you just got one or two days that spike high?
If so, then that's not really an issue.
If it is most days (and it obviously isn't, from the average) then there is a problem.