Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Crawl frequency restrictions? I don't need daily crawling.

         

mojomike

2:59 pm on Oct 19, 2006 (gmt 0)

10+ Year Member



Hi everyone, I am not sure this is the right section but i figured that I would ask.

my web pages don't update that much, and when they do it's only once a week.

since I don't really want the search engines pulling my web pages daily, is there a way to tell Google to do it only once every 7 days?

thanks in advance

Michael

tedster

4:05 am on Oct 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



You can open a Webmaster Tools account for the site. Then use the <changefreq> element in a Google xml sitemap [google.com] to suggest how frequently each page changes. However, that will not be a "rule" for crawling, just a suggestion that they can integrate into their own crawling rules.

moftary

4:15 am on Oct 20, 2006 (gmt 0)

10+ Year Member



How about the following?:
<META name="revisit-after" content=7days >

Cheers,
Hossam

tedster

4:22 am on Oct 20, 2006 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



The revisit-after meta tag is, and always has been, ignored. It never did have any universal use -- I think it was first seen as a proprietary tag for one specific service in earlier days of the web. Google (and other search engines) will lways spider as they see fit for their own purposes and needs, and the xml sitemap is the channel they have offered.

I think you can file the meta tag approach under the "myth" category.