Good catch. I know capacitors can buzz, but isn't that usually when they need to be replaced?
They can emit noise but that is usually in the 5 to 10 milliseconds before the tops dome up and the thing craps out.
I'm at a loss to explain how a cap could "whine".