Smart people can do both. Some people can’t.
But people who aren’t good at math are likely to a) have anxiety about it, and b) have kids with similar challenges.
Had a Calculus prof that was not able to concentrate her thoughts/hand-movement to be able to draw the bracket symbol.
It was kind of funny because she warned the class in advance and she was obviously embarrassed that she just couldn't coordinate the reverse-direction that happens at the point in the middle. Looking back I wish I would have shown her a 'trick' in that instead of a point you make a loop and then just brush away the loop leaving the point. So, no reversal of movement.