Distance would be the big factor. Handgun accuracy after 20 ft drops off sharply, as well as velocity.
A common misconception.
The ability of most people to hit a man-sized target with a handgun drops off sharply. That is what you are likely observing. Most handguns are easily accurate enough to hit man sized targets at a hundred yards.
Yesterday, I was testing (admittedly a very accurate handgun, marketed as a competition model) at a hundred yards. It was not difficult to keep the shots on a half silhouette in 6 inch groups. The problem was me. I cannot see as well as I used to.
At 50 yards I got less than 2 inch groups.
With a common "snub nosed" revolver, when at the peak of my shooting career in college, I could hit beer cans, using a car door as a rest, about 50% of the time at 70 yards.
Velocity does not drop off enough (for most handgun calibers) to make a significant difference in lethality for at least a hundred yards.
A .22 from a handgun, with muzzle velocity at 1000 feet per second, has a velocity of 875 feet per second at 100 yards, for example.
You are seeing a real phenomena, but it is skill level you are observing, not an intrinsic quality of the hardware.