Of course you are right. But the confusion of terms leads occasionally to some strange arguments, so whenever possible, I prefer to use another word. More confusing is the use of the term "conservative", when its meaning in the US is quite different from its meaning elsewhere.
And even more confusing yet is the whole left-right model, with fascists on the right, marxists on the left, and us supposedly teetering in the middle on a slippery slope leading left or right; conservatives being supposedly closer to the right, and therefore closer to fascism than our "liberal" friends, who are supposedly further left and therefore further away from fascism.
Left-right may be a useful way of distinguishing left-fascism from right-fascism, but to refer to American conservatism as if it was "rightist" and somewhere on the fascist/marxist continuum is erroneous. We are not part of that continuum, we are something entirely "else". We are the blood enemies of that entire continuum.
But, of course, its not always possible to explain all that in a short conversation, so for most purposes, if forced to use "liberal" and "conservative" in the way it is commonly used, of course I do.