That argument only works if you can establish that there is at least a remote possibility that life can spontaneously spring from non-life, which science has never been able to establish.
Why would that be any different than our experience here on Earth? At what point did we progress from non-life to what we see around us today? Clearly, carbon-based life forms were not present when the Earth began to coalesce given the temperatures that were present at that time. So we must have made the progression and I see no reason to assume that out of trillions of other galaxies why we should assume that we are the only one that went through the process. Indeed, I think some planet likely went through the process billions of years before we did.