Forum Moderators: open
If Google and other search engines only crawl/index every so often, how is it that current news items show up immediately when I search for them? At most, there's a day's delay. Is there something the news agencies are doing that I can do?
Thanks,
Lori
Welcome to WebmasterWorld
The frequency of freshbot is going to be related to the level of fresh content that you add. If you add very regularly as most news sites do you will see in increased level of crawling. Related to that will be the PR of the site and is crawlability. For example a site may add news on a hourly basis but if GoogleBot cannot get to the content ("hidden" links, monster urls etc) it wont be listed or even crawled.
>>Is there something the news agencies are doing that I can do?
Adding loads of new content with good unique tiltes. They also look at the navigability of the site.
Also, in Yahoo!, the only obits appearing for Redd Stewart are in fact from news agencies. (AND, if you search for "Brian Wright" he does NOT come up, but then if you click on the News tab at the top, his obit does come up...from a news agency.)
The definitive test, IMO: I did find on the Internet two pages with Redd Stewart's death being discussed that were NOT from a news agency and did therefore NOT come up in any search: [groups.yahoo.com...] and [roughstock.com...]
THANK YOU SO MUCH!