He consented to let the officers visit the person. That does not mean he consented to let the officers search the bedroom closets.
If officers were unwilling to enter the property without searching beyond the areas for which consent had been given, they should not have entered the property at all without a warrant.