The fires were started by both Federal and retreating Rebels. But for the most part it was by the Federals, especially the vengeance fires in South Carolina.
Then you probably shouldn’t have used a picture of Richmond, fires the confederates started and the US Army put out.