Many Protestant churches do not proclaim the creeds or recite them as a part of worship but, nonetheless, accept the tenets as the basis of Christian faith.
At the same time, if those creeds draw on extraBiblical materials, you could get in trouble for wandering around the church chanting them.