Or they could obey the Constitution, which says senators serve a term of six years unless expelled by the Senate itself.
The 2nd Amendment gives the people no right to use arms against the government. Such use is by definition unconstitutional, revolutionary and illegal.
Doing so is sometimes necessary, but it cannot be legal, as its purpose is to take needed (or unneeded) measures outside the form of law. The Constitution recognizes the right of the people to keep this ultimate power in reserve, but using it by definition would involve overthrowing the Constitution.
If voters decide an elected official violated his oath of office then, in this case, it will be on the Senate to try and ignore the situation. So far, a Senator being drunk on the Senate floor is okay with the rest of the Senators as long he votes the agenda properly. A violation of oath is just a minor detail. Maybe a good rebuke would make it all go away.
That's like say surgery is felonious assult.