Nobody is ever free from the influence of God. It becomes compelling only to those who freely choose to accept it. For those who choose to hate God, deny and reject him, there is no compulsion, obviously, to believe, so they don't.
How is your position different from Pelagianism?