Bayesian forecasting of electoral outcomes with new parties' competition

Basic Information

• Paper ID: 1612.03073
• Title: Bayesian forecasting of electoral outcomes with new parties' competition
• Authors: Jose Garcia Montalvo, Omiros Papaspiliopoulos, Timothee Stumpf-Fetizon
• Classification: stat.AP (Statistics Applications)
• Publication Date: February 4, 2019
• Paper Link: https://arxiv.org/abs/1612.03073

Abstract

This paper proposes a novel methodology for forecasting electoral outcomes by integrating fundamental models with national polling data within a Bayesian evidence synthesis framework. The approach is particularly suited for electoral prediction in contexts with new party competition, an increasingly common phenomenon in post-2008 European politics. Using the 2015 Spanish parliamentary election as a case study, the authors demonstrate the advantages of their method relative to competing approaches, particularly in predicting parliamentary seat allocation across parties.

Research Background and Motivation

Core Problems

1. Emerging Party Challenge: Traditional electoral forecasting methods are primarily designed for two-party systems or long-established parties, struggling to handle elections with new party participation
2. Seat Allocation Complexity: Most polls predict national-level results, while seat allocation occurs at the local level, involving nonlinear conversion relationships
3. Historical Data Scarcity: New parties lack historical electoral data, rendering traditional time-series regression methods ineffective

Research Significance

• Following the 2008 financial crisis, 45 "insurgent" parties emerged in Europe, capturing 18.3% of parliamentary seats across 27 EU member states
• In Spain's 2015 election, two new parties (Podemos and Ciudadanos) secured over 30% of parliamentary seats
• Traditional forecasting methods performed poorly when facing dramatic shifts in political landscapes

Limitations of Existing Methods

1. Fundamental Models: Rely on historical data and socioeconomic variables, rendering them ineffective for new parties
2. Poll Aggregation: Typically provide only national-level forecasts, overlooking local variations
3. Hybrid Models: Existing approaches require sufficient historical data for regression, unsuitable for new party scenarios

Core Contributions

1. Innovative Hybrid Framework: Proposes a novel hybrid model based on Bayesian evidence synthesis that handles new parties without requiring historical data
2. Multi-level Modeling: Develops a Bayesian hierarchical structure combining provincial, regional, and national-level data
3. Optimized Seat Prediction: Specifically models parliamentary seat allocation, accounting for the nonlinear characteristics of the D'Hondt allocation method
4. Empirical Validation: Validates the method's effectiveness in the 2015 Spanish election, with seat prediction errors significantly lower than alternative approaches

Methodology Details

Task Definition

Input:

• Individual response data from pre-election surveys
• Published polling results
• Census data

Output:

• Vote share predictions for each party in each province
• Parliamentary seat allocation forecasts
• Uncertainty intervals for predictions

Constraints:

• Handle new parties lacking historical data
• Account for D'Hondt seat allocation rules
• Satisfy 3% vote threshold requirements in each province

Model Architecture

1. Fundamental Model

Employs multinomial logistic regression to predict local-level voting intentions:

sₙ|μₙ ~ Multinomial(μₙ)

where μₙ is the voting probability vector at the nth level, computed as:

μₙ(l) = exp(fₙ,ₗ) / Σᴸₘ₌₁ exp(fₙ,ₘ)

Linear combination form:

fₙ,ₗ = αₗ + Σₖ β(k,jₖ[n],l)

2. Polls Model

Establishes an explanatory variance decomposition model for polling errors:

(pₖ - vₜ[ₖ]) ~ N(γⱼ[ₖ] + δₜ[ₖ] + dₖεₜ[ₖ], Σⱼ[ₖ])

where:

• γⱼ: Time-invariant polling house bias (house effect)
• δₜ: Election-level systematic bias (election effect)
• εₜₖ: Temporal trend effect (trending)
• dₖ: Days to election

3. Hybrid Model

Employs Bayesian evidence synthesis:

Prob[electoral outcome|available polls] ∝ Prob[available polls|electoral outcome] × Prob[electoral outcome]

Operational procedure:

1. Generate local result simulations based on the fundamental model
2. Aggregate to national level to obtain vₛ
3. Calculate weights according to the polls model: Wₓ = Probavailable polls|vₛ
4. Compute weighted average: Σₛ g(v₁,ₛ,...,vᵢ,ₛ)Wₛ / Σₛ Wₛ

Technical Innovations

1. Poststratification Technique: Employs census data for poststratification to address survey sample representativeness
2. Inverse Regression Method: Converts explanatory polling models into predictive models
3. Importance Sampling: Uses importance sampling to explore the posterior distribution
4. Seat Allocation Modeling: Directly models the nonlinear seat allocation process of the D'Hondt method

Experimental Setup

Datasets

1. Pre-election Survey: 2015 CIS pre-election survey with 17,452 respondents
2. Historical Polls: 157 election polls (released within 30 days before 1996-2011 parliamentary elections)
3. 2015 Polls: 51 polls (released within 30 days before the election)
4. Census Data: Spanish official census data for poststratification

Evaluation Metrics

1. RMSE: Root Mean Square Error
2. Correlation Coefficient: Correlation between predicted and actual values
3. Seat Prediction Error: Absolute seat number differences
4. Probabilistic Forecasts: Calibration of prediction intervals

Comparison Methods

1. Alternative Fundamental Model: Regression model with GDP growth rate and lagged election results
2. Alternative Polls Model: Simple poll averaging
3. Alternative Hybrid Model: Classical hybrid regression model by Lewis-Beck et al.

Implementation Details

• Bayesian inference using Stan
• MCMC sampling: 4 chains, 2000 iterations per chain
• Uncertainty amplification factor: 1.5× constant term uncertainty
• Hierarchical modeling using standard prior distributions

Experimental Results

Main Results

Vote Share Predictions (2015 Election)

Seat Predictions (2015 Election)

Key Findings

1. Significant Seat Prediction Advantage: The proposed method reduces seat prediction errors by approximately 70% compared to alternative methods
2. Poll Weighting: In national average predictions, the fundamental model receives approximately 35% weight while the polls model receives 65%
3. Geographic Distribution: The model successfully captures geographic distribution characteristics of different parties

Ablation Studies

1. Fundamental Model Alone: RMSE of 0.04-0.06, correlation coefficients of 0.78-0.90
2. Polls Model Alone: Accurate at national level but unable to provide local information
3. Combined Effect: The hybrid model combines advantages of both, performing best in seat prediction

Related Work

Main Research Directions

1. Fundamental Model Approaches: Structured methods based on historical and socioeconomic data (e.g., Hibbs' "bread and peace" model)
2. Poll Aggregation: Poll weighting averaging and prediction market methods
3. Hybrid Models: Integrated forecasting methods combining fundamental variables and polling data

Innovations in This Paper

1. New Party Handling: First systematic approach to addressing electoral prediction with new party participation
2. Multi-level Integration: Innovatively combines individual-level survey data with aggregate-level polling data
3. Seat-Oriented: Specifically optimizes for parliamentary seat allocation rather than focusing solely on vote share

Conclusions and Discussion

Main Conclusions

1. The proposed Bayesian hybrid method effectively handles electoral forecasting with new party participation
2. The method significantly outperforms traditional approaches in seat prediction
3. Poststratification techniques and evidence synthesis frameworks provide new technical pathways for electoral forecasting

Limitations

1. Calibration Issues: CIS survey data exhibits systematic variance overestimation problems
2. Computational Complexity: Bayesian inference and importance sampling incur high computational costs
3. Prior Dependence: Method performance depends on reasonable prior distribution specification

Future Directions

1. Improve calibration methods for survey data
2. Extend to other electoral systems and countries
3. Integrate new data sources such as social media

In-Depth Evaluation

Strengths

1. Strong Methodological Innovation: First systematic approach to addressing new party electoral prediction, an important problem
2. Solid Theoretical Foundation: Based on modern Bayesian hierarchical model theory
3. Sufficient Empirical Validation: Uses real election data for validation with compelling results
4. High Practical Value: Method can be directly applied to actual electoral forecasting

Weaknesses

1. Single Case Validation: Primarily based on the 2015 Spanish election; generalization capability requires further verification
2. Computational Efficiency: Bayesian inference is computationally complex, potentially challenging for real-time forecasting
3. Data Requirements: Requires high-quality individual survey data, which may be difficult to obtain in some countries

Impact

1. Academic Contribution: Provides new methodological framework for electoral forecasting
2. Practical Application: Method has been applied to subsequent electoral forecasting practice
3. Cross-disciplinary Value: Method can be generalized to other prediction scenarios involving new actor competition

Applicable Scenarios

1. Electoral environments with rapidly changing political landscapes
2. Elections with new parties or candidates participating
3. Situations requiring precise seat allocation predictions in proportional representation systems
4. Forecasting scenarios with available individual survey and polling data

References

1. Hibbs, D. A. (2008). Implications of the 'bread and peace' model for the 2008 US presidential election
2. Lewis-Beck, M. & Dassonneville, R. (2016). Forecasting methods in Europe: synthetic models
3. Park, D. K., Gelman, A., & Bafumi, J. (2004). Bayesian multilevel estimation with poststratification
4. Gelman, A. & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models

Summary: This paper makes important methodological innovations in electoral forecasting, particularly in providing effective solutions to the increasingly important problem of new party participation in modern democratic elections. While it has certain limitations, both its theoretical contributions and practical value are noteworthy.