No, or not really. The person has to generate their own private key, it can't be done any other way securely. But after that the user has to prove they are a voter. So they appear in person with a public key to register as a voter. Or more likely they will send their proof online along with their public key. Then the government will allow that person to vote.
So in theory there could be a central authority that could be hacked. But in a manual implementation that is not possible. There is a public key registration process where you prove you are a citizen. That could be completely manual and unhackable (although still flawed since the humans could be bribed).
So now you’re using the same ol’ voter registration system that’s been getting abused forever and there’s already tons of ways to game the system. A manual implementation is one of the easiest ones to fool, just start making fake IDs. Welfare frauds beat this system every day.