There are an abundant number of smaller, minor fault zones throughout the Sierras. Very low probability of a major quake in that area, you are correct. Fault movement in the Sierra largely vertical, block faulting. However, you are not totally out of the woods. If Mammoth mtn/long valley suddenedly act up (there would be some precursors) or the transverse fault zone (Mohave) act up, you could catch spill over.
Lets all be done with it and just by beach front property in Arizona.
Not to mention the volcano growing in Mammoth Mountain by Twin Lakes.