In that area there are no “poor areas of town” unless you count houses less than 800k as poor.
Have you been to East Palo Alto? Separate town but next door.