“Does soil and climate matter?”
Yes.
Pot does best in a rich, well drained loam and temps between 60 and 90 deg. Quality and quantity suffer outside those boundaries.
Someone hit it right though in remarking that today it is largely grown indoors. That’s how they make it more potent.