You need to slide slightly into one as he passes you.
Seriously.
Knock him off his bike, spectacularly. If he is on the sidewalk where there is a bike lane nearby, you are completely in the right. It’s easy to do without getting hurt.
I say this as an avid bicyclist that commuted for over a decade in the Seattle area from multiple homes. If they are not breaking the law, leave them be. But if they are creating a dangerous situation, well, there’s nothing like tough love to help them get the message.
Our little area is on the route for the 'hundred mile' group, and we literally don't get in the cars that day due to them riding four or five abreast and totally ignoring any rules of the road -- this neighborhood consists of stop signs versus lights, and it's as if those don't exist.