If the infant dies before that selfishness is manifested, then all have not sinned. I think that we can understand that Paul's teaching would be directed to those who could understand it.
I think your onto something.