You don’t understand “pass by” and “leave”. In fact, you’re relying on a stereotypical view of Calvinism rather than on what they themselves say. There’s no reason you should know that much about Calvinism; there was a time that I, too, thought they all believed as the Primitive Baptists do.
Boy was I wrong.
Oh, I understand completely. That’s the fudge factor. What you may not be taking into account is the original sin of Adam. Calvinists say that was also predestined. So using the term “passing by” someone now doesn’t absolve them of anything. They still confess that the entire “chain of events” was predestined. If God predestined Adam to sin and all have that sin nature because of it there is no getting around that it’s double predestination.