Most bats are truely harmless and actually beneficial little critters.
It would be nice if more people, like you, would build more bat-houses to help compensate for the loss of caves, old barns, etc. where they used to hang-out.
OTOH, there is a legitimate concern about bats being a carrier of rabies, so one needs to be careful that children & pets don't get too curious around these critters.