"Why? Because I must answer to myself. That's why."
So then, each man answers to himself. What you are saying is that right and wrong are relative to the man himself?
Our concepts of right and wrong arose out of hard-learned and painful historic lessons. There are certain ethical and moral rules that are necessary for the proper and orderly functioning of any society, from a hunter-gatherer clan to a post-industrial constitutional republic of 300 million.
Historically, we have often cloaked such rules in religious cloth to give them even more legitimacy.