Yep....I try not to anger any of them. Good luck......go to your best gun shop around that has a big selection with an indoor range and test what you like best. Sounds like you already understand recoil and weight from your magnum revolver. In that case....you will probably be disappointed in anything under a .40 caliber although the James Bond looking Sig 232 and the similar Walther or Berreta .380 or 9mm semis are at least "interesting" as well from an asthetic perspective.
The smallest handbag semi of any consequence is the North American Arms Guardian in .380.....full time double action but quite small, well made and inexpensive. We have one. We like it...for what it is. If you see one check it out just for sh!ts and giggles.
Good Night...