Absolutely, bullet setback upon repeated chambering is a significant risk factor that is difficult to diagnose after the gun explodes.
Of course, if those are expensive Cor-Bon rounds or the like, this gets expensive. On the other hand, you should shoot hundreds of rounds with your carry round, to be CERTAIN you gun doesn’t have trouble with them.
I have good luck with controlling the slide until the bullet contacts the feed ramp, and then releasing it to chamber. Not advisable under every circumstance, but it works if you pay attention and assuming the gun will reliably chamber and lock up from that position. It usually works fine because you've already done most of the work to push the round out of the mag.
I also inspect my ammo and rotate it to the range periodically.