To the partisans, those things always matter, but to the people in the middle who only pay attention in the last couple of months before the election, they only care about who looks better on tv during the debates.
No, when they have a strong economy, what you state does not hold true at all.