You listed the first film that came to my mind, The Ghost and Mrs. Muir. My children enjoyed that growing up, and it works for adults too.
There’s also The Uninvited from 1944 with Ray Milland. That’s a good one, too.