In NYC or Chicago, you have to worry about getting mugged.
In LA, it's the drug gang problem.
In San Fran or Berkeley, you'd just have to worry about your sanity, due to your neighbors crackpot ideas.... But all of them have punitive taxes.
I think the ‘desirability’ of living someplace is better related to by population density.
The more ‘dense’ the population, the more problems.