There are two sins here. One is receiving federal funds. Stop taking federal funds and you won't have the second sin.
Exactly. There are Christian colleges who will not take any federal funds, including Stafford and Parent PLUS loans. Grove City is one. Hillsdale, I believe, is another. Students who attend who require loans, must obtain them through private institutions.