No his name stays on the ballot. Votes cast for him will be counted for a replacement candidate named by the GOP!
But how will the voters know who is the GOP replacement candidate?