I honestly don't think he cares what people think. A leader makes a decision.
Unlike Clinton, who governed by polls, he doesn't need to have 51% or more of the country on his side to do what he thinks is right. He makes decisions and he sticks to them.
Reagan had the same attribute.
A leader also leads - that is, convinces people he is right. A leader without followers is just an odd fellow.