The Dept of ED mostly administers the Title IV student loan program. However, that function could be shifted to Treasury.
Well, it is the Treasury that garnishes the people who don’t pay back their student loans, so it is a good fit.