"Yes.... but the poor children are innocent and shouldn't be considered in such a derogatory light."
That's true. However, their concubine mother shouldn't be seen favorably at all. Imagine growing up to be the children of the wife killer. Hopefully they won't be judged for their father.
Correction: hope they won't be judged for their father's murderous traits.