Always wear hearing protection. ANything is better than nothing. Even if shooting a .22 Hearing loss is cumulative. So you might go out today and have do affect but prolonged exposure is what gets you. It isn’t always the decibel level either.
Off topic but when going to the movies i bring ear plugs