Nope. That's exactly what happens.
Good catch on that. Testosterone has a bad feedback mechanism, while an estrogen blocker is apparently what is needed to help the body make sperm.
https://www.freedomfertility.com/blog/medications-used-for-male-infertility/