"All have sinned, and fallen short of the glory of God". "There is none righteous, no, not one". "There is none who seek after God".
Your view would only work if man was born innocent, and then decided to sin, or not. But that's not the case. All men are sinners from birth, indeed from conception. As such, they are guilty before God, and rightly deserve God's Wrath. If God chooses to save some and not others, that is not an issue of unfairness, it is a manifestation of His Mercy. God is not obligated to save even one person. Mercy is God's to give, to whom He wills, not man's to demand on the basis of a flawed concept of fairness and equal opportunity.
All mankind is equally guilty before God. Thus, the field is level at that point. God can choose some to save, and do no injustice to those not chosen, because He is not obligated to any of them, and it's His choice to make, not theirs to demand. The unchosen are done no injustice, because their fate is Just, and they are guilty. Injustice would be leaving one unsaved who was not guilty of sin. But, if he was not guilty of sin, he would not need to be saved, because he already is right with God.
There isn't any question that all have sinned and merit punishment. Therefore, all start out on the same depraved level, guilty before God. The Psalmist (33:5) says He loves justice and judgment and (85:10) that "mercy and truth are met together, justice and peace have kissed each other." Mercy, truth and justice are not mutually exclusive attributes of God. His justice demands that His mercy be offered to all sinners and His justice demands that those that do not avail themselves of that mercy be punished. His truth demands that the offer be real. No, no one can demand anything of God except what He has already revealed about Himself and that He act in character.