I could be mistaken, but I believe in theory the Speaker of the House can be any US Citizen. It doesn’t necessarily have to be a member of the House.
I believe you are correct.