You can get a drug discount card from many sources for free and there is no penalty, that is what I did for myself.
It’s a financial judgement call. Having been in cancer treatment for several years, for me Part D was a no-brainer.