Alternatively, any civilization that reaches a suitable planet may discover that any life existing there is extremely toxic to their systems. Our best defense against a colonizing life form could be E. coli, for example.
That's what I've always thought. Any civilization that stays around long enough to develop travel between the stars will probably get hit by a civilization-destroying asteroid before that every happens.