I think the reason he has always denied that he was at the meeting is that he knew of a terrorist plot to assassinate U.S. Senators and did not report it.
That bears repeating, as well as the idea that he went out and stumped for them for close to two years afterward, KNOWING these were people who even considered assassination as a political tool. How are these people different from terrorists again?