Posted on 05/10/2015 11:00:45 PM PDT by Cincinatus' Wife
The website of Nate Silver, the American polling expert, surveyed all of Britains public-opinion surveys on Election day in Britain and declared that the chance that David Camerons Conservatives would win a majority of seats was vanishingly small when the polls closed around 1 in 500.
But that is precisely what happened, leading Nate Silver to write a piece titled The World May Have a Polling Problem. He listed the errors that overtook probably the four highest-profile elections of the past year, at least from the standpoint of the U.S. and U.K. media:
1) The final polls in the Scottish-independence referendum showed the no side winning by just 2 to 3 percentage points. It won by nearly 11 percentage points.
2) Polls significantly underestimated the GOPs performance in the 2014 midterm elections last November. In the Senate, GOP margins were about 4 points better than the polls in the average Senate race. The 2014 election was, on average, tied with 2002 as the second-worst polling year for Senate races in a quarter century (the worst was 1998).
3) In Israel, polls badly underestimated the performance of the right-wing Likud Party, projecting it would win about 22 seats in the Knesset; in fact, it won 30.
Silver came up with various explanations for the errors, noting first of all that voters are becoming harder to contact, so pollsters rely less on direct contact and more on online questionnaires. Some of those online polls abandon probability sampling, the bedrock of polling methodology. In addition, he also observed that some pollsters have been caught withholding results when they differ from other surveys, herding toward a false consensus about a race instead of behaving independently.
Two examples of herding in the 2014 election appeared in the Kansas and Virginia Senate races. Pollsters there didnt release their numbers because they deviated too much from what others showed. In that way, Virginia voters were badly served because no late published poll caught Republican Ed Gillespies last-minute surge that almost defeated Democratic incumbent Mark Warner.
In Britains election last week, we see another troubling instance of herding. The polling firm Survation admitted that its final poll showed the Conservatives with a lead of 37 percent to 31 percent over the Labor Party almost the exact final result. The companys CEO explained why he failed to publish the poll: The results seemed so out of line with all the polling conducted by ourselves and our peers what poll commentators would term an outlier that I chickened out of publishing the figures something Im sure Ill always regret.
There is a pro-Labor and anti-Conservative bias in polls.
This is playing with dynamite. Pollsters in Britain have long realized the potential polling problem created by the shy Tory vote referring to those voters who dont want to admit to pollsters that they are going against the grain of media coverage and might cast a politically incorrect vote. But this is the third time in 50 years that the shy Tories have swung an election (it also happened in 1970 and 1992). Apparently, polling companies havent been able to solve the problem. Chris Hanretty, the academic who advised the BBC on polling, told Britains Guardian newspaper that he feels a little bit foolish, in the wake of the election. We categorically ruled out a [Conservative] majority. . . . We should have expected far more shy Tories.
Pollster Stephen Fisher also told the Guardian that the problem is more complex than that. Noting that polling companies have consistently exaggerated the Labor vote since the 1970s, he concluded: Polling companies have done a lot of work to try to counteract this, but it keeps happening. There is a pro-Labor and anti-Conservative bias in polls.
Rem Korteeweg, a senior research fellow at the Center for European Research in London told the New York Times: People say who they are voting for with their heart and then vote with their wallets.
Im not sure thats the case, but even if it is, the problem of people giving politically correct responses to pollsters isnt confined to Britain. As Nate Silver concluded, Polls, in the U.K. and in other places around the world, appear to be getting worse as it becomes more challenging to contact a representative sample of voters.
The science of polling has been through rough patches before, and experts have conducted reviews and done postmortems. But whatever the reason the increased use of cell phones, the inability of pollsters to reach people, and a tendency to avoid giving politically incorrect answers to strangers on the phone the problem isnt close to being fixed.
Leighton Vaughan Williams, director of the Political Forecasting Unit at Nottingham Business School, sums it up: If you really want to know a likely election result, ignore the polls and look at the betting markets. Its a mystery why pollsters are taken more seriously. From now on, if pollsters are to regain any credibility, they must be more transparent, spend the money to conduct real surveys, resist the temptation to withhold polls they dont like, and realize that more and more of the public is starting to pick up a whiff of the same bias in pollsters that they detect in the media as a whole.
Uhhh...
Me too.
Read up on the Dems big voter targeting systems (Narwal, Catalyst).
There’s no doubt they use polling as a means of gathering the data necessary to develop individual voter profiles.
How about a more simple answer....people feel like the polls are trying to manipulate them so they manipulate back.
In short...they are lying to the pollsters!
Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.