Welcome to WebmasterWorld Guest from 18.104.22.168
Using the yo-yo mechanism to gradually release a url from a penalty sounds like a step Google might take. They could gather some good data about the url's performance at a higher position that might be useful for them.
I have the same rankings I've had for ages for only 3-4 days at a time then drop out for a week or more only to recover for 3-4 days again.
It's an old site that's been around since 2001. Haven't made any changes that would cause this to happen.