"Whilst we assert for ourselves a freedom to embrace, to profess and observe the Religion which we believe to be of divine origin, we cannot deny equal freedom to those whose minds have not yet yielded to the evidence which has convinced us. If this freedom be abused, it is an offense against God, not against man: To God, therefore, not to man, must an account of it be rendered." (James Madison, in Memorial and Remonstrance)
Thus, the obligation falls upon Believers to guarantee the rights of those who do not believe in a God or gods.