Buddha did not abandon his wife and children (all royalty) - he had promised to return - and lamented over that separation that would result from his taking up the quest. Upon his return, they were among his first disciples - an unlikely feat if they really bore anger towards him for "abandoning" them. A similar argument could be said of Christopher Columbus, too, who left family (who did not have any equivalent royal protection) to go beyond the "edge of the world".
"For I am come to set a man at variance against his father, and the daughter against her mother, and the daughter in law against her mother in law. He that loveth his father or mother more than me is not worthy of me: and he that loveth his son or daughter more than me is not worthy of me."
- Matthew 10:35-37
Tigerseye can probably elaborate better.
I’ve heard that complaint before. As if attaining ultimate enlightenment was less important. I couldn’t feel too sorry for his wife and children though being left in the care of his father who was the king. They were the most favored royals in a very rich kingdom. Which they also willingly abandoned to become his disciples after he attained Buddhahood.
Mark 33:32-34 also comes to mind.