Of course he is not proposing a 100% e-money system, just doing away with larger bills. That is troubling though, nonetheless as it aids in the downward creep of the cashless system.
As well as the fact the government can confiscate any amount of that money it likes under whatever "legal" pretext it decides sounds legitimate. It's called asset forfeiture. No conviction of a crime required.