Is it likely that freshbot will crawl a new site that has just been deep crawled? I've noticed its hit one of my sites but just keeps getting the robots.txt and doesn't crawl the rest of my pages.
korkus2000
3:01 pm on Jan 7, 2003 (gmt 0)
Its not likely but also not impossible. If your site raises the flags to have fresh listings then expect visits. What those flags are I don't think we really know.
