For receiving the Eucharist, not at all times.
Yes...at all times in church.
http://blog.adw.org/2010/05/should-women-cover-their-heads-in-church/