That which cannot interbreed is a species.
Limited fertility represents not-yet-complete speciation.
In layman's terms - yes. In strict scientific terms, its not the complete picture. Ring species and asexual organisms both blow huge holes in that simplistic definition.