I think smells, rodents and fire hazards are all good things to wonder about! But all have solutions.
I've designed a barn with living quarters in it for my boarding stable. My idea is the barn and that place will go up first, and a house perhaps later. Mine is a small apt and would make a good office or quarters for a caretaker person later.