Unfortunately the parts most people see are the area around the Cruise Terminal and the ports. There are some very nice places near by in the Marina, but then when you go up to Gaffey and Pacific it's a bit sketchy. Some gentrification is going on on 5th and 6th Streets, but it's moving quite slowly. I remember when we first brought our daughter down there for school, there were shops selling shirts that proclaimed "San Pedro, where the Ghetto meets the Sea". Made us a bit nervous! LOL As you up the hill, and get near or cross Western, it's quite a nice place.
Haven't been down in a few years, but anything along Paseo del Mar was always pleasant and I visited friends many times in South Shores and husband kept boat in the Marina. I wonder how much the houses go for now.