Colbert is his real name, and Stewart is hardly the only Jewish entertainer to change his name. Just ask Mel Brooks.
Everyone else in his family pronounces it col-bert. He changed the pronunciation to col-bayer.
At least that’s what I read somewhere.