Taking it another step further - if you don't let the police come into your house and search it - if you have nothing to hide, then you wouldn't have a problem with that.
Refusing to let your house, car or person be searched is cause for suspicion, and requires the cop to take action.
My understanding is that you have a reasonable expectation of privacy in your home or in your car. You don’t have a the right to privacy if you are out in public, particularly if you are involved in any incident with others.