If you're the kind that likes confrontation, it might be worth a shot. Refuse, and see what they do when the ball is in their court.
I don't particularly like confrontations, but I feel this is an invasion of my privacy.
And they are making an assumption I am stealing from them.