Right after dark, spray Raid wasp killer directly in the holes.
That’s what the bee keeper did for us. We had a nest in the ceiling of our kitchen. We got a bushel full of dead bees out of there. Oh, he also wore a special suit to protect himself from angry bees!