To properly regression test, there should be a way to circumvent the randomness so as to get a repeatable answer. Otherwise, how do you distinguish between a breaking change and an expected random result?
Yep. In several places, I gather. I suspect randomness is introduced in more than one place/variable in the chain.