Block 3: How good is the prediction?
Week 7 · Prediction I · Imai §4.1.1 · about 5 min
NoteHow this works
Run each cell with Run Code, look at the output, then answer the question at the end of the block. Every cell is editable; Start Over resets it. Errors are information: read them.
How good is the prediction? We compare the poll prediction (poll.pred, computed in the background) with the actual result.
1. Bias and RMSE
2. Predicted vs. actual margin
Points on the dashed line are perfect predictions. Points in the upper-left or lower-right quadrant are misclassified winners.
3. Classification: did the polls call the winner?
Conclusion: How good is the poll prediction?
The bias is only 1.1 points, but the typical state-level error (RMSE) is 5.9 points. Indiana, Missouri and North Carolina were misclassified, with tiny actual margins (+1, -1, +1 points). Predicted 349 electoral votes, Obama actually won 364.