That’s how distillation works.
The only caveat to an instant “yes” is, as noted, surfaces and atmospherics may introduce impurities as the manufacturer did not intend the purity of the results.
I once had a dog that used to drink out of the humidifier all the time. Didn’t seem to hurt her.