For the money, a nice used revolver in good condition is a good place to start IMO. The .38 special is a common, ubiquitous caliber that works.
I suggest starting at a reputable gun shop and mention the terms "J-Frame" or "K-Frame", these are both families of revolvers made by Smith and Wesson.
Kinda like buying a car, don't let anyone twist your arm, and buy after you've done some shopping, preferably with an experienced person as you mentioned.
When you go shooting, use eye and ear protection. Save your empties in a dry place NOT in a sealed container.
Oh yeah one last, gratuitous point that I learned the hard way: As YOU get more experienced and start taking people shooting with you, NEVER take a known jerk shooting with you. Let him fend for himself, even if he is someone's BIL. Only take people who can be trusted.
Today I went to my local police station to get a fire arms application. Let’s see how it goes.