Yo Nate...2016 ya had Hilda at 71.4%
At 28.6%, he gave Trump a far higher possibility of winning than every other pollster. He was also the only one who predicted that Trump could win the electoral college without winning the popular vote.
He is also currently predicting an 82.3% chance that Republicans keep the Senate.
So no, I wouldn't panic, but I would put more stock in Nate Silver than in a lot of other pundits.