I had a ‘63 Volkswagen bug the heater of which consisted of opening up a valve to who-knew-where and enjoying about as much heat as lighting a match gives.
The heater “worked” by passing cooling fan (always running) air over the outside of the exhaust manifolds, IIRC. Hence the leaky exhaust gassing you.