Garrison's biggest problem is that he's always wanted to be F. Scott Fitzgerald, and he has never figured out why he hasn't gained the respect from New York society that he deserves.
That one, he doesn't deserve it, and two, their "respect" isn't worth anything, just doesn't seem to register.