If that was the case, the amendment would say something like "Congress shall make no law..." instead of the blanket prohibition against infringement.
I learn something every day.