Mostly water ice crystals blown away from the comet's coma by solar radiation and wind. Any chunks picked up from the asteroid belt would follow the comet around the sun.