What an interesting observation, and I agree completely. Comedy is all about premises and truths and absurdities, and there are a lot of logical elements that must align very precisely for it to be effective. Drama, on the other hand, just has to feel right.
Comedy is all about making new (il)logical connections between things. You have to make the connection yourself for the joke to be funny, that's why jokes are less funny when you don't understand them and then someone explains them to you.