He still can’t make the authorities punish him if he is given a pardon. They will simply make him go away and stop bothering them.
Correct. The pardon refusal is under different circumstances, before trial or before appeals are completed. Even if volunteering for punishment, a president could commute the sentence instead and get him out of everyone’s hair.