That was Winston Churchill’s phrase and I still think he secretly was referring to their boarding (”public”) school system (hold the rum).
He may have popularized it, but it was around long before Sir Winston and it referred to The Royal Navy. I believe you are mixing up two different descriptions—one of the navy and one of the Brit public schools.