Another possible alibi is provided per post #28. The brothers were described as useless drunkards. So, they could have been at the house and been drunk and passed out, and then kicked out in the morning.
All three of them were probably useless drunks. Drunks, of course, can be very, very dangerous. Nothing worse than a mean drunk.