For me, that's not the issue. The issue is of bicyclists insisting on taking roads where their presence inconveniences to the point of danger the motorists who live in the area. It's illegal to ride bicycles on freeways. It should be illegal to ride them on busy, winding, double-lined two-lane highways that cannot safely accommodate bicyclists and cars simultaneously.
But it isn't and you need to deal with it.
Are there other parts of the public infrastructure you claim dominion over, other than roads? Do you assert the right to control who sees the Grand Canyon, Library of Congress or Lake Michigan (darn canoes)? Perhaps you feel the urge to limit who can use the local sewage facility?
Darn Amish with their horse and buggy, and stupid farmers with tractors slow down traffic on winding country roads. Deal with it.