DC is not actually a territory. It is the one and only federal district. As such, congress has complete control, by the constitution and the District of Columbia Organic Act of 1801, which codifies that in federal law.
The Speaker of the House is the Commander of the Capitol Police Force.
The Speaker of the House is the Commandant of the Capitol Jail.