If I block a certain search bot using robots.txt, how long would it be before they check my rules again?
I ask as I want to save a bit of bandwith ( it's running low ) and would like to know if when I then allow the bot .. how long It'll be untill the bot acts in the normal manner again?
Cheers