Yes.
Richard Abanes outlined this, saying this started with Smith sleeping with wives of other men.
"Other Mormons followed suit. Consider Lucinda Pendleton. She is widely known for having married first Smith, then Brigham Young after Smith's murder. But what is commonly overlooked is that she married Smith and Young while STILL married to a George Harris. And Zina Huntington married Brigham Young while still married to Henry Jacobs. Jacobs, in fact, stood as a witness. Wife-swapping was eventually looked upon as wholly acceptable if an influential church authority was involved. Jedediah M. Grant, for example, admitted, 'If President Young wants my wives I will give them to him without a grumble, and he can take them whenever he likes.' Grant also explained, ["]What would a man of God say, who felt aright, when Joseph [Smith] asked him for his money? He would say, "Yes, and I wish I had more to help to build up the kingdom of God." Or if he came and said, "I want your wife?" "O yes," he would say, "here she is; there are plenty more." The Confessions of John D. Lee confirmed wife-swapping in Utah, saying, 'Some have mutually agreed to exchange wives.' One of Brigham's own brothers, Lorenzo Young, engaged in just such a trade with a Mr. Decker, whose wife was wanted by Lorenzo. The two men simply swapped mates." (Inside Today's Mormonism, p. 237, Harvest House, 2004, citing Lee's book, p. 165 and other sources)
The grass may be greener; but it still has to be mowed.