A contempt of Congress should invoke some immediate consequences.
At minimal a suspension. Loss of security clearance.
Wray does not want this, he's not a crazed ideologue like Mayorkis who could care less. Wray thinks this will tarnish his reputation and the FBI, and that will bother him. He believes this is a start to holding the FBI's feet to the fire and he'd prefer to avoid that.