You're not alone. Others have trouble with his stuff, too.
2 Peter 3:15-16
15Bear in mind that our Lord's patience means salvation, just as our dear brother Paul also wrote you with the wisdom that God gave him. He writes the same way in all his letters, speaking in them of these matters. His letters contain some things that are hard to understand, which ignorant and unstable people distort, as they do the other Scriptures, to their own destruction.
Peter of course castigates "ignorant" people. That is those people who refuse to listen to proper teaching authority.