I think the drug addiction has overruled much of Hunter’s ability to process anything rationally. Also, it doesn’t seem like he ever has been very intelligent, and certainly there is no reason to think he comes by intelligence through heredity.
The family also seems to have an attitude of being untouchable, so Hunter probably felt like he was safe.
"You obviously don't know WHO I AM!"