Jesse_Smith - 6:05 am on Oct 31, 2003 (gmt 0)

With my sites that have PRs/back-links, they get deepcrawled daily, and I think have one MAJOR deepcrawl each month (been geting Google-bombed since Friday, almost crashing the server.) While with new sites, they hardly get touched. Started making a new site about two months ago. Made one category and then linked to it on another site that was on the same topic. With in a day Google crawled that section. I kept adding more content and sections, and on 10/04/03 when I killed If-Modified-Since, BANG, Google crawled the whole site, but after that it's only got one file, the original index page, get's it almost daily and leaves, even with If-Modified-Since turned off, so I'm not sure what's up with new sites. (No, I don't have session IDs, or .cgi/php/asp files, all static .shtml files).