What exactly is it that you actually know now that you didn't know then that would have compelled you to say no?
They were no more a grave and gathering threat than Iran, Syria, Pakistan, etc.