I’ve done both, (Scouts, not SP) and I have to agree with you!! SM is much more admin oriented.
At the mere hint that Stake President might be in my future (or even Bishop), I’ll be joining colorcountry! (Just kidding...sort of.)
It’s funny because it’s true. I’ve served in a few Bishoprics, and the running joke is that I’d break a major commandment to keep off the “hit list”
JK of course! ;-0