The Japs tried this
A fire balloon (風船爆弾 fūsen bakudan?, lit. "balloon bomb"), or Fu-Go, was a weapon launched by Japan during World War II.