Operator Learning for Power Systems Simulation

Basic Information

• Paper ID: 2510.09704
• Title: Operator Learning for Power Systems Simulation
• Authors: Matthew Schlegel (University of Calgary), Matthew E. Taylor (University of Alberta), Mostafa Farrokhabadi (University of Calgary)
• Classification: cs.LG
• Publication Venue/Conference: NeurIPS 2025 Workshop on Tackling Climate Change with Machine Learning
• Paper Link: https://arxiv.org/abs/2510.09704

Abstract

Time-domain simulation (i.e., modeling system evolution over time) is an essential tool for studying and enhancing power system stability and dynamic performance. However, for grids with high renewable energy penetration, these simulations become computationally infeasible due to the requirement for extremely small simulation time steps (1-50 microseconds) to capture the ultra-fast dynamics of renewable energy sources. This paper explores operator learning as a surrogate model for these expensive simulations, and for the first time investigates the fundamental concept of simulation time step invariance, enabling models trained on coarse time steps to generalize to fine-resolution dynamics. The paper benchmarks three operator learning methods on a simple test system, evaluating zero-shot super-resolution and generalization capabilities across stable and unstable dynamic regimes.

Research Background and Motivation

Problem Context

1. Computational Bottleneck: Time-domain simulation of grids with high renewable energy penetration requires extremely small time steps of 1-50 microseconds to capture ultra-fast dynamics related to inverters, making system-level simulation computationally infeasible
2. Practical Urgency: Events such as the April 2025 blackout in Spain and Portugal underscore the pressing need for scalable real-time analysis tools
3. Climate Change: Overcoming computational barriers is critical for stable integration of renewable energy as required by climate change mitigation policies

Limitations of Existing Approaches

1. Classifier Methods: Can only determine system stability states and cannot serve as surrogate models for time-domain simulation or be used for control design
2. Component Replacement Methods: Require complex interfaces to integrate machine learning components into the differential equations of the remaining system
3. Full-System Surrogate Models: Demand extensive training, validation, and generalization testing

Core Contributions

1. First Introduction of Time Step Invariance Concept: Enables models trained on coarse time steps to generalize to fine-resolution dynamics
2. Zero-Shot Super-Resolution Benchmarking: Compares performance of three operator learning methods on zero-shot super-resolution generalization
3. Generalization Analysis Across Dynamic Regimes: Analyzes model generalization capabilities between stable and unstable dynamic mechanisms
4. Pathway for Renewable Energy Integration: Provides scalable and computationally feasible analysis tools supporting stable renewable energy integration

Methodology Details

Task Definition

Learn an operator G that maps initial trajectories t ∈ 0, τ to future desired trajectories t ∈ τᵢ, T generated by ordinary differential equations.

Three Operator Learning Methods

1. Deep Operator Networks (DeepONets)

• Architecture: Employs two neural network branches
  • Branch network processes input trajectories
  • Trunk network encodes output query times
• Output: Produces predicted trajectory values through inner product combination of the two branches

2. Fourier Neural Operators (FNOs)

• Core Idea: Projects input to Fourier basis, applies learned spectral multipliers, then transforms back to time domain
• Advantages: Spectral representation captures smooth temporal structure and supports resolution changes
• Enhancement: Uses tensorization to reduce parameter count while maintaining accuracy

3. Latent Neural ODEs (LNODEs)

• Architecture: Encoder-decoder structure
  • Encodes input trajectories to latent state
  • Evolves latent state through neural ODE
  • Decodes back to original space
• Solvers: Evaluates fixed-step (Adams) and adaptive-step (Dormand-Prince-Shampine) solvers

SMIB Test System

Uses a Single Machine Infinite Bus (SMIB) system, where a synchronous generator is connected to a stiff voltage source through a transmission line. Generator rotor angle dynamics are governed by:

$\frac{\partial^2\delta}{\partial t^2} = \frac{\pi f_0}{H}\left(P_m - D\frac{\partial\delta}{\partial t} - \frac{|E||V|}{X}\sin\delta\right)$

where δ(t) is rotor angle, Pₘ is mechanical power input, D is damping coefficient, E and V are voltages, X is transmission line reactance, H is inertia constant, and f₀ is nominal frequency.

Experimental Setup

Data Generation

• Parameter Sampling: Pₘ ~ U0, 2, D ~ 0.0, 0.135
• Stable Trajectories: Pₘ1 ~ U0.0, Pₘₐₓ_m1, where Pₘₐₓ_m1 is determined by equations (2) and (3)
• Unstable Trajectories: Approximated lower bound using 100 bisection searches
• Data Scale: 8000 training trajectories and 1000 validation trajectories per dataset
• Time Windows: Input sequence t ∈ 0, 0.2s, target sequence t ∈ 0.3, 3.1s

Model Training

• Hyperparameter Optimization: 120 Bayesian optimization trials
• Parameter Count: All models approximately 700k parameters for fair comparison
• Loss Function: H¹ Sobolev norm loss
• Training Epochs: 60 epochs for LNODE and FNO, 600 epochs for DeepONet

Evaluation Metrics

• Zero-Shot Super-Resolution: RMSE and performance degradation percentage
• Dynamic Regime Generalization: Mean Absolute Scaled Error

Experimental Results

Zero-Shot Super-Resolution Results

Key Findings

1. LNODE Superior Performance: LNODE achieves minimal performance degradation in zero-shot super-resolution tasks
2. FNO Excellent Absolute Performance: FNO achieves lowest RMSE at original training resolution, but exhibits largest performance degradation at high resolution
3. Significant Generalization Differences: LNODE performance degradation of only 8.6% and 7.3% compared to over 45% for DeepONet and FNO

Dynamic Regime Generalization

• Training Data Impact: Models trained solely on stable trajectories struggle to generalize to unstable regions
• Mixed Training Effectiveness: Training data containing 20% unstable trajectories enables all methods to capture unstable region dynamics
• DeepONet Advantage: In mixed training, DeepONet is the only method maintaining similar performance in stable regions

Related Work

Classification of Machine Learning Methods for Power Systems

1. Classifier Methods: Determine system stability states and stability margins, but cannot serve as surrogate models
2. Surrogate Modeling Methods:
   • Component Replacement: Approximates differential equations of individual components with models
   • Full-System Modeling: Designs data-driven surrogate models for entire systems (this paper's approach)

Operator Learning Applications in Power Systems

• Neural ODEs: Applied to modeling independent power system components
• DeepONet: Applied to modeling power systems after disturbances
• FNO: First application in power system modeling

Conclusions and Discussion

Main Conclusions

1. Time Step Invariance Feasibility: Operator learning methods can achieve generalization from coarse to fine time steps
2. Method Performance Differences: LNODE performs best on zero-shot super-resolution, while FNO excels in absolute accuracy
3. Training Data Importance: Mixed training data containing both stable and unstable trajectories is crucial for generalization

Limitations

1. System Complexity: SMIB system is too simple to capture complex dynamics of high renewable penetration grids
2. Practical Validation: Requires comprehensive modeling and testing on realistic test systems
3. Method Comparison: Requires additional testing to verify method competitiveness under different inductive biases

Future Directions

1. Complex System Modeling: Extension to realistic high renewable penetration grids
2. Practical Testing: Validation of method effectiveness on actual power systems
3. Algorithm Improvement: Exploration of better inductive biases and architectural designs

In-Depth Evaluation

Strengths

1. Strong Novelty: First introduction of time step invariance concept to power system simulation
2. Important Problem: Addresses critical computational bottleneck in renewable energy integration
3. Comprehensive Methodology: Systematically compares three mainstream operator learning methods
4. Rigorous Experimental Design: Comprehensive evaluation of zero-shot super-resolution and dynamic regime generalization
5. Social Significance: Directly serves climate change mitigation objectives

Weaknesses

1. Simple Test System: SMIB system fails to reflect actual grid complexity
2. Limited Generalization: Generalization across dynamic regimes remains challenging
3. Insufficient Theoretical Analysis: Lacks theoretical guarantees for time step invariance
4. Unverified Practicality: Requires validation on large-scale realistic systems

Impact

1. Academic Contribution: Opens new machine learning direction for power system simulation
2. Practical Value: Provides pathway for addressing computational challenges in renewable energy integration
3. Reproducibility: Provides GitHub code repository facilitating subsequent research

Applicable Scenarios

1. Fast Power System Simulation: Scenarios requiring real-time or near-real-time analysis
2. Renewable Energy Integration: Stability analysis of high-penetration renewable energy grids
3. Multi-Resolution Modeling: Complex systems requiring cross-timescale modeling

References

The paper cites 25 relevant references covering operator learning theory, power system modeling, machine learning methods, and other important works across multiple domains, providing solid theoretical foundation for the research.

Overall Assessment: This is a pioneering work in power system simulation with significant theoretical and practical value. Although currently validated only on simple systems, it provides novel approaches and methods for addressing key technical challenges in renewable energy integration. The introduction of the time step invariance concept merits further in-depth research and expanded applications.