Couple of things I thought of. 1. you need a super strong material that won’t crush or deform under its own weight. 2. You may need multiple stairwells to deal with the pressure difference from the ground to the top. 3. You would have to account for differences in expansion and contraction of the building because of temp differences.
1. A tall (16?)brick one in Chicago massive eight feet thick walls. Things have improved...
https://en.wikipedia.org/wiki/Monadnock_Building
2. Even a typical high rise has draft stops and some pressure adjustment from the HVAC blowers.
3. Usually, a curtain wall exterior moderates the temperature and is independent of the structure.
A cool video on building the St Louis Arch.
The two columns did not align for the keystone because of sun/temp differentials.
They had the fire department hose one side for proper alignment.
For black iron ~ 1 inch for 100 degrees F , for 100 feet.
Add a skosh for stainless like the Arch.
That said they have it covered, I think?