It was originally orange the color, not orange the citrus fruit. I thought it might be an Ulster William of Orange thing, but no other college wanted to be orange, so Syracuse grabbed it.
Bingo.
They were the Orangemen until 2004.