Welcome to WebmasterWorld Guest from 220.127.116.11
Forum Moderators: mademetop
It's a pretty large site, hundreds of pages, dynamic URLs and refreshed frequently.
We let the Google and Yahoo find the pages themselves. Our PageRank is 7, with about 650 inbound links from other sites.
Is this the type of lag time that everyone deals with?
Or is there something we can do to improve it, such as:
1) Manually re-submit a few pivotal pages to Google to "goose" it.
2) Add a full site map from the home page (would be pretty chaotic -- and considerably over the acceptable 100 links, would this be frowned upon by the SE's?)
3) Something else entirely?
Thanks so much in advance for replying to this newbie's question.
The index page has a new additions / updated pages section linking to the new content - new pages, which normally sit 2 levels down the navigation tree, usually show up in google's index in a couple of days (ranking however takes a bit longer :P )
We are finding that Google takes about 20 days to crawl our site, and that Yahoo takes 30.
I would consider this about right.
I wouldn't do anything you mused about. I would be concerned about it backfiring. I find that adding new content frequently is the best way to get the bots a-crawling.
I don't think that getting a *complete* crawl any faster would be an advantage anyway.
I think that if you put up a lot of new content every day then their will be a good chance that search engines crawl through your site every 1-2 days.
We are linked by many sites with very high PR. We update our content maybe weekly. The dynamic URLs can be a couple levels deep.
Given this add'l info -- would adding a site map off the index page for updated content help? (Thanks mcavill for the idea.
Should we manually resubmit the home page to Google when we add content?
Force a single daily change to content? (Thanks Zygoot)
Anything else you can suggest?
Or will it take a lot more than these "tweaks"....like changing the site structure entirely to make the dynamic URLS static-looking :(
Really, bottomline, we're updating or adding specific pages on a approximately a weekly basis, but could be more often -- and we want to insure that those pages are crawled pronto.
Add an updated page site map off the index page?
Submit the home page manually?
And then cross our fingers and hope for the best?
Thanks a lot.