True enough, except that not much 3He is present in the lunar soil -- the highest concentrations are on the order of one part per billion.
Ah, but since fusion energy doesn't require a whole lot of mass, and the He3 is not strongly bound to the lunar soil, even a ppb level is economically feasible.