As Hebrews 13:4 points out, the marriage bed is undefiled.
In the context that your usage of the word chaste in relation to one who is married means undefiled by adultery, I can agree.