You are right. I did see a barn full of hay burn a few weeks ago. It was an old horse barn/stables that the current owner was storing only round bales of hay inside. The building was destroyed and bales of the hay were still smoldering one week later when I passed by.
My horses are vulnerable and trapped if my hay blows.... I don't like it.