The mathematics approach infinity only at the singularity of a black hole, not the event horizon which forms the most important part of it. General relativity and mathematics still agree there.
The very idea of a singularity is an absurdity.
But you don’t have a black hole without one, do you?
So you’re dependent on infinities all the way through, it’s the very basis of the assertion that black holes exist.