I do account and can consider it a failure but the reality is as much as they could stand against him it wouldn’t have prevented him from getting there as they were too small in numbers.
That situation I don’t think is comparable to a legislative effort.
Ryan had set as one of the conditions for his acceptance of the Speakership that he receive the backing of all caucuses. The Freedom Caucus had the power to prevent him from assuming that office, and instead they gave him a super-majority: