Just run CCleaner every time you re-open your computer. That's what I do. And yeah, it's annoying.
CCleaner shuts down Edge when I first open the computer.
But if I run CCleaner later ... sometimes it doesn't shut down Edge again, but sometimes it does. Which means that Edge had resurrected itself, running in the background without letting me know.