I don’t worry about. Bought gold for the first time years ago and it immediately lost $100 per oz. Still have it. Silver, I am still ahead, just not as much. Never put everything into one investment.
I hold for the insurance aspect, not for investing - have gone Galt. That said, buy low and sell high - guess what, prices are at three year low!