Uhhhh....step back and recall the “congress shall make no law” part of A1.
I think you’ll find that the founding father’s still accepted the need for certain restrictions on freedom of speech (i.e. libel and slander laws) so that people cannot simply say what they want with malicious intent.