Or Chinese sky lanterns.
Yeah. If you watch the whole video, you see the overall trajectory is down.
Like a slowly falling large garbage bag with a fire/candle in it. The wind blows them around so the lights disappear once in a while, and then the fire/candle appears again.
If he recorded a few more minutes, they would have all landed somewhere out to sea.