It's ok to doubt, as long as it doesn't lead to UNBELIEF.
However; if you 'start to worship something else' then it would appear that you no longer believe than Jesus is your savior.
Because of unbelief they were broken off, and you stand by faith. Do not be haughty, but fear. 21 For if God did not spare the natural branches, He may not spare you either.