Besides, it would be quite easy to avoid news of this conference.
He was raised by an antisemite. How does he get rid of that influence on his own life?
OTOH he has tried, apparently, to live it down, as witness his prompt apology when sobered up, which gainsays the second half of your statement.
To try to ride him down on everything now because of his father's unseemly passion strikes me as vindictive, as if his father's antisemitism is deemed by Gibson's critics to have worked "corruption of blood" in Mel Gibson and his family, to borrow the language of the Constitution (forbidding such punitiveness even for treason).