A .50, heck even a .40 or .38, would be too big for someone like me.
The genius of Barrett is the recoil reduction. You could handle a .50.
Get the right .38 and I guarantee it won’t be too big - ours is lovely and not too big at all. My XD40 is pretty small too, even for someone with tiny hands like me.