Why couldn't they do this with any constitutional provision - say the 2nd amendment?
Once there's no judicial review anything goes.
They are by the Constitution the final arbiters of the meaning of the Constitution. The power of Congress to exclude the courts is pretty clear in the Constitution.