NO, they have a name because they have a political agenda and opponents, their agenda, their political purpose, is to defeat the conservatives, to fight for social liberalism, to oppose social conservatism.
If they were merely silent individuals who were indifferent to the culture war between the left and right, then we wouldn't know who they are, but we do, because they have a political agenda, something that they promote, fight for, argue for, they have a goal, and it means defeating the conservatives at all levels of government.
Government is the use of force to influence behavior. I don’t want the social conservatives using force to restrict my behaviors in any way beyond that of preventing substantial injury to the general health, safety, peace and security of my community. Nor do I want the leftists to use force to coerce behaviors they find “appropriate” and “sustainable.”
The 10th Amendment implies that the individual retained certain rights from government. If that is libertarian and not conservative, so be it.