Mathematics is "hard" because it takes discipline. It's not a subject where you can "baffle 'em with BS". I always did bad in math until I got to college and realized I actually had to study and work example problems. Once I got the basics down, I started getting A's and made it all the way through Calc 3. If someone told me when I was in high school that I could take (let alone understand) higher math I would have thought they were nuts.
I am glad to read that you're beyond your need for 'science courses', though I believe it a way of life. Instead I'll suggest engaging in the Science Wars and reading the genre of literature epitomized by Paul R. Gross and Norman Levitt's works, including Higher Superstition: The Academic Left's Quarrels with Science (JHU, Baltimore, 1998, ISBN 0-8018-5707-4) and The Flight From Science and Reason (NYAS, NY, 1997, ISBN 0-8018-5676-0). The bibliographies will suggest titles to appeal to your particular bent. Also Alan Sokal's seminal essay and foreign literature. Maybe The Bell Curve too? Tagline
It's like hitting a curve ball. I used to teach high school algebra and used this as an analogy. I compared doing your homework to taking your daily batting practice if you played baseball.
Same here for math. I never took Trig because I had such rotten math teachers for Algebra and Geometry. It was a college prof that finally explained it in a way that made sense. I also passed 3 semsters of Calc. Never would have dreamed it in a million years.
The opposite of being "hard" in this sense would be "relative": the hogwash notion that something might be "true for you" but not "true for me."
Don't get me started on THAT one.