I take it literally- God is NOT with them- hence the wish for God TO be with them.
And if they will accept, God will have no grudges. It’s we silly humans, laden with our sin that blinds us to God’s superior and awesome purposes, who have the grudges... yes even some of the supposedly theologically savvy ones of us.