Are you sure you are not thinking of Poe v. Ullman, 367 U.S. 497, 516 -522 (dissenting opinion - See more at: http://caselaw.findlaw.com/us-supreme-court/381/479.html#sthash.oXszuUAR.dpuf
Note it is a dissenting opinion
-PJ