The misperception (especially as promoted by atheists) is that atheists don't believe in God.
They do. At best they simply make a conscius choice to turn their backs to Him. At worst they openly hate Him and those who accept Him.