The answer to this is in the scripture you quote.
Deuteronomy 4 2 Do not add to what I command you and do not subtract from it, but keep the commands of the LORD your God that I give you.
These commands were for Israel, and that's who this refers to.
Who did God say this to? Did he say it to the Egyptian Pharaoh, or a heathen nation?
God holds those who he enters an agreement with, and not those who were not a part of it.
JH
Except for the fact that a mixed multitude came out of Egypt and any sojourners with them had to abide commands as well.
Then those who are not a part of it should abstain from quoting those passages as support for their positions. If they are not relevent to the non-Catholic, then they can't be used to beat a Catholic over the head. Simple consistency.