| 4:00 am on Oct 3, 2002 (gmt 0)|
This should change shortly after that page is spidered next. When that will be of course is uncertain. Google usually grabs my main site index.htm page at least once every 2 days. However, perhaps Google actually trusts you and will wait a couple weeks. ;)
| 12:08 pm on Oct 3, 2002 (gmt 0)|
Okay, so what your saying is that once you submit a new site and it is indexed, it will be spidered several times during the month. Not just one time before the dance, right?
| 12:42 pm on Oct 3, 2002 (gmt 0)|
Depends on the site. Some sites get a fresh tag every few days, others every few weeks, others just during the dance. Would need more info.
| 3:54 pm on Oct 3, 2002 (gmt 0)|
What determines how many times they will crawl the site?
Or is there no specific reason for how many times?
| 4:17 pm on Oct 3, 2002 (gmt 0)|
One factor is new content. Sites that continually update their content are spidered on a regular basis and frequently.
| 4:21 pm on Oct 3, 2002 (gmt 0)|
another factor is number of external links.. the more links you have the more the bot is likely to stumble into your site and grab some info while it's there.
| 4:23 pm on Oct 3, 2002 (gmt 0)|
Another factor is being listed near the top of the Yahoo directory. These sites are spidered frequently.
| 4:24 pm on Oct 3, 2002 (gmt 0)|
Same with being listed in Dmoz. (As opposed to not being listed..)