Part of the Speaker gig is travelling a lot and holding fundraisers for Congress members. Ryan doesn’t want to do that and would rather spend his time at home.
Yeah, that’s one part of the job- the job he didn’t want.
I don’t think that was the ONLY reason.