Perhaps for some, but not for others. I am 62, 6'2", 215 lb., 36 waist. I exercise at least 30 minutes every day and often 60 to 90 minutes per workout (cardio every day and weights 2x per week). I am not fat. We eat very well (mostly home-cooked meals) because my wife is a Type 1 diabetic. And yet, I must now take meds to keep the blood sugar in check.
Chronic blood sugar elevation is the initial issue that causes the rest of the cascade of problems with diabetes. It would seem that, since you are not overweight, insulin is not pumping your blood sugar into extra fat cells, for some reason. Regardless, you should still be able to get off the medicines, but it would take some added effort.
You can continue with the medicine, but it does sound like the spiral is not yet checked for you, and I really encourage you to give these things more of a try. At the very least, if staying with carbs, strive for the lowest Glycemic Load items you can possibly eat and see if that brings down your numbers through the day.
Try the zero carb carnivore diet. I’ve been on it the last four years.