blend27 - 9:35 pm on Nov 20, 2012 (gmt 0)
+ what TheMadScientist said!
I usually restrict access to fresh content til all bots(well 4, no slurp though) get to it by placing programming logic layer around the content.
Something like "coming soon".. But then all that is wrapped in White Listed Residential(repeat visitors), COUNTRY Blocks, Hosting Ranges/Data centers Firewall Blocks. And new content chuncks on pages for real visitors are served via AJAX till the bots get to it.