He never said it in office either, and he had been there since 1999. They tried to derail Bush in both his election and reelection and were both terms were contested.
Ryan hasn’t made any public statements of significant at all. On any topic. He’s been basically radio silent the last two years. That he is not so randomly dipping his toes in this issue very telling. They all hate Trump and want him gone.