I think that individual body chemistry definitely plays into people's tolerance of these shots. Not saying that they're not dangerous, some people can just overcome their poison better than others. Long term, no one knows.
I think there is a chance that it is also batch related, some batches have a variance that is not understood, not controlled and has serious consequences. If you hid the VAERs data then there is no way of learning about this.