There are plenty of actions (not to mention thoughts, words, and intentions) other than sexual intercourse which are violations of chastity for a man who has taken vows as a priest or a husband.
I once was chastized for going fly fishing on my mother-in-law’s birthday.