The problem I have is that I am very small framed and live entirely in sweat pants in cold weather then shorts during the warmer months. Nothing I wear requires a belt so I am limited to paddle holsters which due to the weight of the pistol, pulls down the sweat pants or shorts on the side of the gun........LOL!
I suggest that you take the advice of the late JUSTIN WILSON, AKA: THE SAGE OF CAJUNLAND, & become a SAFETY MAN.
(CHUCKLE)
Yours, ex-cadet
A belly band might work for wearing sweats or shorts and carrying compact pistols. There are also some small trigger covers with lanyards on them that go well with belly bands for a little extra safety. Just hook the lanyard (piece of tiny rope) to an eyelet or something on the belly band.