I haven't been to Boston metro in ages but that's how I remember that area too. Here's what the Wikipedia entry for Hingham has to say about its demographics:
The racial makeup of the town was 97.5% White, 0.40% Black or African American, 0.04% Native American, 0.88% Asian, 0.02% Pacific Islander, 0.22% from other races, and 0.95% from two or more races. Hispanic or Latino of any race were 0.75% of the population.[33]
But it is only 5 minutes by car from Quincy, which has a big drug problem.
Oddly enough, Quincy is mostly Asian.
Maybe 10 minutes by car from Dorchester, which DOES have a “Yout” Gang problem.