When the Treaty of Paris of 1898 was signed which ended the Spanish-American War, the U.S. received Puerto Rico, Guam and the Philippines as territories. Under the peace treaty Spain also gave up control of Cuba and the U.S. administered the island from April, 1899 until Cuba became the independent Republic of Cuba on May 20, 1902.
Cuba was never an official U.S. Territory.