So do you declare everyone outside of your faith a heretic?
Not everyone outside the Orthodox faith: only Christians who knowingly deny the Orthodox faith, while purporting to be Christians. Non-Christians aren't heretics, though if they used to be Christians, they are apostates.