This would not be fair unless the payouts were also graduated.
Screw fair.
Get past the notion that it is your money that you are putting into Social Security.
It is this notion that makes rational policy on Social Security impossible and makes the impending train-wreck inevitable.
Eventually Social Security will morph into a system that guarantees retirement security to the indigent. This will be all that we can afford, once the demographic shifts kick in. Tax policy should reflect this fact, and dedicated funding for Social Security must end.