Tbere are greater and lesser sins. There are greater and lesser distances from perfection. It was not the ideal for David to have multiple wives, but that was never brought up as one of God’s concerns with him.
I find I’m constantly battling becoming too “legalist” and then too “anything goes thanks to grace”. It doesn’t have the wild swings it used to have, but it is a constant struggle.