You are looking at it from a wrong perspective. The man who made the original Hilton fortune worked in the large part to make his children and granchildren comfortable (like any normal person.)
So the question should be, did he deserve to pass his wealth to his descendants as was surely his intention? And the answer is yes.
Fine, so what about the brave knights who risked their life, who displayed the nobility of character and defended their nation from deadly enemies. Did they deserve to preserve their privileges and status to their descendants?