Since you are an atheist, why do you care? Everything outside of your physical senses in irrevant. A Buddist would say you are accumulating bad karma by not following their teachings. Does this person bother you also? Any attention to these teachings leads to perplexing dilemmas. Focus on the perfection to be achieved within yourself for the proper dominance over others. Read the teachings of Nietzsche and Hegel, and read about those who followed their example to find your true course.
You seem to think there's something like an Atheists' Creed that you have to sign onto if you reject major religion. Me, I care deeply about things outside my own physical senses. You apparently need a giant grownup in the sky to tell you not to smack old ladies upside the head and steal their purses.