At that point in the show, Burr is reflecting back on his interactions with Hamilton. He’s had a lifetime of conflict with the bastard (his words), and is venting.
It really is helpful to know the context of these words.
Not everyone is portrayed as low and disgusting.
I invite you to hold loosely onto your opinions until you’ve personally spent time with this American classic.