Actually there was a third: by marriage.
Didn't work for my mother, a war bride from The Big Show. When my dad was posted overseas (U.S. military) she had to stay in the States and file papers for citizenship, because if she'd followed him prematurely to his foreign posting, she'd have had difficulty reentering the U.S. later on, since she was still a foreign national.
It wasn’t that way until the Cable Act in 1922 when it became possible to have 2 citizen households.