Well, the extent to which HE was talking about it (or conversely, attempting to conceal it) might be relevant to the issue of whether this activity was a problem for him. I don't know to what extent he was talking or writing about this "hobby" of his.
Generally, though, I tend to agree with your major premise that recreational gambling is usually no one else's business.