It is often assumed that Jewish prisoners of war were brought back to Rome and contributed to the massive workforce needed for the construction of the amphitheatre, but there is no ancient evidence for that; it would, nonetheless, be commensurate with Roman practice to add humiliation to the defeated population
Whether or not the Colosseum was built by Jewish slaves, it was almost certainly built by slave labor. The Empire was built on it.