Fox has not yet said there will be a season 6. If there is, killing off his character might be a good idea.
If the need to get rid of him, the can script it that he was killed on the street by two guys from Nigeria.