FWIW, I find time to go to the gym by getting up at 5:30 to get there. That way I don’t have to worry about babysitters or anything else. Plus, traffic is much lighter at that time of the day.
I take it you don’t have a 1 year old who has trouble sleeping through the night.