2018 was a very good year for polls

Statewide polling also had a strong year, although it should be noted that Senate and governors’ polling did pick fewer winners than usual.

The average poll in the Senate was off by only 4.2 points. The average Senate poll historically has been off by 5.2 points, which means this year’s polls were a point better than average. Likewise, the average governor’s poll had an error rate of 4.4 points. That’s 0.7 point more accurate than the average governor’s poll since 1998.

But there were also a number of cases where the polling had one candidate winning but the other candidate won the election. This year nonpartisan Senate polls called the correct winner 77% of the time, compared with 84% historically. Governor polls saw a nearly identical 76% of races called correctly, compared with 84% historically.

Why the difference? Much of it has to do with a lot of races forecast to be close this year. Over 20% of pre-election polls for the Senate and governor’s races had margins of 2 points or less. Historically that’s under 20%.

You can see that when you look at the averages in some of the individual states. The average poll in the Florida governor’s race was off by 4.4 points, which isn’t any larger than the average for gubernatorial polls this year. It just so happened that the race was tight and the polling error was enough to tilt the winner from Democrat Andrew Gillum in the polling to Republican Ron DeSantis in the results. The same thing occurred in the Senate race, where the average poll was better than average (just 3 points off), but the race was close enough for a polling error to flip it from Democrat Bill Nelson to Republican Rick Scott.

This wasn’t a big problem on the House side, where the leader in 83% of district polling ended up winning the race. That’s better than the 80% historical average.

Now, you might be wondering if the polling misses this year were more likely to benefit Democrats or Republicans. Obviously, even if polling errors were smaller than average, it would be bad if one side benefited from them.

There were some states where the polls were biased. The polls were once again too favorable to Democratic candidates in Midwestern states like Indiana, Michigan and Ohio, though not in Pennsylvania or Wisconsin. And like in 2016, the polls were too favorable to Democrats in Florida and Republicans in Nevada. Repeated patterns of bias in the polling is somewhat worrying.

Unlike 2016, this year the errors tended to cancel each other out, as one would hope they would.

The average governor and Senate polls were about a point more favorable to the Democrats than the result. The average generic congressional ballot and House district polls were less than a point more favorable to Republicans than the actual result.

Overall, the average poll was about 0.5 point more favorable to Democrats than the final result. In only one other cycle since 1998 did the polling have less of a bias toward either the Democrats or Republicans. In other words, 2018 polls were solid and without bias compared with the average cycle.

I should point out that the accuracy of polling this year does not mean we’re undergoing some sort of polling renaissance, where the polls will be awesome from now on. In 2020, the polls may be more inaccurate than they were this year.

The predictiveness of polling in 2018, though, does reaffirm that polling isn’t becoming more inaccurate. As long as we recognize that polls are tools and aren’t going to be perfect, they remain the best way outside of an election to understand how the public is feeling about the country.