In this case it's the perpetrator of the crime that suffers more than the victim. I am not directly hurt by other people's willful ignorance, but it's like watching an autistic child bang his head against a table.
People pretty much get to live the kind of lives they wish to live.