Butterfly milkweed is pretty durable, you might not need to bring it in. What growing zone are you in?
(PS: Butterly Milkweed is also known as Pleurisy Root, and is used as an antiviral. If you want to, you can grow the roots as a cash crop. Harvest in their 3rd year.)
S.E. Michigan.....