at some point, your (and my, and those of everyone else) ancestors start to appear in the family tree at multiple loci, as the divergent branches cross each other.
this is not a problem.
Still I need 8 great grandparents discounting everyone else. 20 generations ago I, myself had to of had 1,048,576 grandparents whether they were shared by many others or not. A biological fact, right?