I believe Sheriff Andy Taylor kicked them out of Mayberry, too. Although I think Millie wanted to marry one of them.