Or perhaps the propensity for Federal troops to bombard civilians?
Consider US General Gillmore's demand of the Confederates. In August 1863, he demanded "immediate evacuation of Morris Island and Fort Sumter by the Confederate forces" or else he would fire upon the city of Charleston "from batteries already established within easy and effective range of the heart of the city."
The Confederates didn't surrender the forts, and the Union army bombarded civilians in Charleston for the next 18 months.
The Star of the West ignored the efforts of a pilot boat placed at the entrance of the channel by Governor Pickens to warn her off. The guard boat General Clinch then saw her and preceded her up the channel firing rockets to alert the Confederate gunners. The Star of the West then ignored a warning shot placed across their bow by the shore guns. Finally, the shore gunners started shooting at the ship itself, perhaps no surprise to a captain who proceeded right along after being warned.
To paraphrase your logic, the owner of the Star of the West got his ship back, didn't he?