Well its Closer than what happened to the Dixie Chicks but its still not a First Amendment Issue.
Ted does not have a "Right" to play a concert anywhere even Fort Knox. The People who hire him to play Concerts can change there mind and decide they don't want him, whether there is pay involved or not.
the people hiring him is the federal government.