The fact that you have a right of free speech doesn't imply that you can go into somebody's house - someone who has graciously invited you into that house to enjoy its benefits - insult the owner, and expect not to be shown to the door.
Your right to swing your fist ends at Jim Robinson's nose.
Or do you think you have rights but Jim doesn't?
The analogy is a poor one. Most people who invite others to their home do not then ask their guest to pay their mortgage.