This is a nice, simple rule. Never use could of. It is always could have.
The same rule applies to should have and would have. It is never correct to say should of or would of. The correct version is always could have, should have, or would have.
I could have been a contender. We should have taken the bus. It would have been faster.