Forum Moderators: open
our most important page - index.html - was last spidered 5 weeks ago, but in that time google has visited 1000s of our other pages, some of them more than once. and yet it is the index page which we regularly update (ca. 4 times per week) with news stories to try and entice freshbot...
in this time we have made a lot of sitewide improvements, meaning everytime googlebot comes back and checks the headers in our site, it finds 100s of pages which have all changed since the last visit, so it just chews through them and doesn't pay any special attention to the index.html?
does the above sound plausible? if so...
then once we stop making all these improvements (i.e. the site settles down to some semblance of stability) then googlebot should be able to see that it is actually our index.html which is updated most often and thus needs the most spider-attention?
anyone had anything similar?
Have you recently tried getting some new site external inbound links to your index page?
yes, we've launched a real campaign over the last 2 months (induced by those fantastic link development threads by paynt and others just recently), but i suspect it will take a while before these are all indexed by G.
freshbot is finding our new pages within days of them going online - sometimes within hours (!), but the index.html is being lost in the wash.
i think patience is the key
cheers
