Sorry but that's idiotic. A common ancestor would be further removed from us than the neanderthal and all parties agree that the Neanderthal is too far removed to be an ancestor. That's like claiming that dogs are too far genetically removed from wolves to be descended from them and that, therefore, they (dogs) must be descended directly from fish.
Besides, Neaderthals created art, hunted, and made fire. Does that sound like an advanced ape to you?
Certainly it does. You clearly haven't kept up with the last 30 years worth of work with Gorillas. Some of the ones which have been taught deaf signs check out as having IQs in the 90 - 105 range which is adequate for half of all American jobs. It's only the lack of voluntary control of breathing which prevents their speaking English.
Both of my parents are dead. There does not exist any person I could be a direct descendant of. Does that mean I have no ancestors?
As for your gorilla example, show me a gorilla species that makes fire and buries it's dead.