Forum Moderators: open
Does google crawl the same sites at about the same time each month?
I understand that there is a cutoff point for crawls that happen after a certain
date will appear on the next months update. What is this cutoff time?
Thank you.
If you have a high page rank (PR) Google will crawl and update the site every day. Low PR usually means that that your listings will be updated once a month even though the crawl is spread over several days or weeks.
Forget the revisit tag. It is useless!!!
<meta name="Revisit" content="After 7 days">
This tag is at least as good:
<meta name="Revisit" content="Please visit my site every day and give me top rankings. Please">
;)
Google only reads the title tag so keep it simple.
What about new sites. How does the crawler treat them when it comes
across new sites in terms of frequency establishment for crawls. I guess
PR applies here to. If it determines the PR is 8 or higher it will crawl+update everyday.
Is this a fair conclusion?