No, should not make any difference. I am in 6 B and I have several fig trees growing in ground.
Thanks, 6B, maybe I can plant some figs by my cabin in West Virginia, a little above 1,000 feet.