You could be limp-wristing it. It is very easy to do with a small pistol.
Try this next time: If you are right handed, hold the pistol with the right hand and have your left hand grip your right wrist. By doing that you will lock your wrist; thus preventing limp-wristing. See if that helps. I also find that it is easier to control small pistols this way. Consequentially, I am more accurate.
I’ll give it a shot, so to speak. Thank you.