Especially if you take the mask off with gloves still on your hands, or before washing your hands if you don't wear gloves. Otherwise, as long as you wear gloves and take those off as soon as you enter your car (gloves should always be the first off), you should be fine. And roll the gloves inside out when peeling them off.
"If you “took off the mask”, couldn’t there be virus on your hands and in the car?"