I didn’t realize it was possible to turn down a pardon.
Yes, one has to accept it.
By accepting a pardon, you formally admit guilt.