Edge won’t let you remove it, and it runs in the background unless you turn it off in settings.
I disabled the ability of edge to access the internet and removed it as a default in all instances. Short of deleting it I think that's the best you can do.
You can download Windows ISOs designed for international audiences where Edge is an optional feature.
Looks for the K or N versions of Windows for a “freer” Windows experience.