In theory perhaps, but not in practice..
And regarding your other statement, what about life imprisonment, or the death penalty? What use is it to say that a person is at liberty to go about his business, after the sentence has been served in full?
Well obviously not if they're dead..
The same can be said about gun ownership, but you quite clearly said that is a right. What's your point?