That puts the Constitution in conflict to read it that way — shall not infringe is a bright line rule.
Not really, because there are other bright lines that protect life, liberty and property. The right to keep and bear arms is both a liberty and a right to property. Nobody at the time felt that felons had a right to anything - by committing a felony, and being fairly convicted (much of the bill of rights concerns the fairness of the judicial process) criminals forfeit any or potentially all of their rights.
Your only plausible argument is an 8th amendment one -- that taking away gun rights is "cruel and unusual." But there you're getting into squishy progressive territory.