Japan is very sexist. Women are expected to quit for work after marriage. Their jobs become solely taking care of their husbands and their family.
Concubines would fit in perfectly to the social climate. In fact, I thought it was the accepted norm the world over? Silly Prince.