That's one idea on how to organize society. It leads to the rule of the apparatchiks and, ultimately, falls apart because the talented object.
From each according to his ability, to each according to his ability.
It may not be just but it works. The most talented people end up doing the work for which they are best-suited...which is a pretty good start.
And what's just?
There's nothing wonderful about the untalented, the stupid, the ugly, the poor, the unfortunate. Simply put, there are huge numbers of such people and their wishes and welfare can be discounted only at great risk to a society. Our ideas of justice spring from that realization.
'Rats aren't interested in justice. They're interested in power.