[escapefromboston]

I am sure Hinduism is a fine religion (I really don't know much about about it) but that caste system always really annoyed me.
Is the caste system built into hinduism?

[CarrotAndStick]

The caste system, per say, wasn't originally based on race or colour, but on occupation. And since occupations can change with the generations, so could caste, sometimes within the same generation itself. A supporting fact is Krishna, one of the pivotal gods in the Hindu pantheon, was from a community generally seen as oppressed.
The discriminatory angle came much later on in history. That's why the Vedas and the Puranas, some of the oldest philosophical and theological works in the world(circa 2000 BC), has nothing mentioned in it about caste.
My explanation is based on the limited facts I know. So, clarification will help if available.

[Cronos]

I am sure Hinduism is a fine religion (I really don't know much about about it) but that caste system always really annoyed me. Is the caste system built into hinduism?

Well, actually Hinduism isn't really a religion -- more like a meta-religion (to use comp speak), with a vast variety of gods etc. It doesn't have a central book or teaching. ANd the term Hindu was originally coined by the Persians to signify anyone living east of the Indus river