We used to do it in little league. That’s part of the game. If your signs get stolen, you’re not doing a good job of concealing them, which is also part of baseball.
When teams are using electronic surveillance to get your plays in football game is infinitely worse than trying to figure out hand signals in a baseball game.