Filtering Problem for Random Processes with Stationary Increments

Basic Information

• Paper ID: 2510.14023
• Title: Filtering Problem for Random Processes with Stationary Increments
• Authors: Maksym Luz, Mykhailo Moklyachuk (Taras Shevchenko National University of Kyiv, Ukraine)
• Classification: math.ST stat.TH
• Published Journal: Contemporary Mathematics and Statistics (2015) Vol. 3 No. 1 pp. 8-27
• Paper Link: https://arxiv.org/abs/2510.14023

Abstract

This paper investigates the optimal mean-square filtering problem for linear functionals $A\xi=\int_0^{\infty}a(t)\xi(-t)dt$ and $A_T\xi=\int_0^T a(t)\xi(-t)dt$ of random processes ξ(t) with stationary n-th order increments. The observed data consists of the process ξ(t) + η(t) at times t ≤ 0, where η(t) is a stationary process uncorrelated with ξ(t). The paper presents the mean-square error values and spectral characteristics of optimal linear estimates when the process spectral density is known. For cases where only an admissible set of spectral densities is available, the paper provides relationships for determining the least favorable spectral density and minimax spectral characteristics.

Research Background and Motivation

1. Core Problem: This research addresses the filtering estimation problem for random processes with stationary n-th order increments, which represents an important generalization of classical stationary random process theory.
2. Problem Significance:
   • Stationary increment processes are more prevalent in practical applications, such as financial time series and signal processing
   • Traditional Kolmogorov-Wiener filtering theory primarily targets stationary processes, with limited capability for handling non-stationary processes
3. Limitations of Existing Methods:
   • Most research assumes the spectral density is completely known, whereas practical applications typically only provide spectral density estimates
   • Lack of robust methods for handling spectral density uncertainty
4. Research Motivation:
   • Extend classical filtering theory to broader classes of random processes
   • Develop minimax robust methods for handling spectral density uncertainty
   • Provide more reliable estimation methods for practical applications

Core Contributions

1. Theoretical Extension: Extends optimal filtering theory from stationary processes to random processes with stationary n-th order increments
2. Optimal Estimation Formulas: Provides explicit formulas for spectral characteristics and mean-square errors of optimal linear estimates for linear functionals $A\xi$ and $A_T\xi$
3. Robust Methods: Proposes minimax robust filtering methods to handle cases where spectral density is incompletely known
4. Least Favorable Spectral Density: Establishes characterization conditions for the least favorable spectral density for different classes of admissible spectral densities

Methodology Details

Task Definition

Input:

• Observed process: ζ(t) = ξ(t) + η(t), t ≤ 0
• Where ξ(t) has stationary n-th order increments, and η(t) is a stationary noise process

Output:

• Optimal estimate of the linear functional $A\xi = \int_0^{\infty}a(t)\xi(-t)dt$
• Optimal estimate of the finite-time functional $A_T\xi = \int_0^T a(t)\xi(-t)dt$

Constraints:

• ξ(t) and η(t) are uncorrelated
• Satisfy minimality condition (8) and condition (9)

Theoretical Framework

1. Spectral Representation of Stationary n-th Order Increment Processes

The random n-th order increment is defined as: $\xi^{(n)}(t,\tau) = (1-B_\tau)^n\xi(t) = \sum_{l=0}^n (-1)^l C_n^l \xi(t-l\tau)$

Its spectral representation is: $\xi^{(n)}(t,\tau) = \int_{-\infty}^{\infty} e^{it\lambda} \frac{(1-e^{-i\lambda\tau})^n}{(1+i\lambda)^n} \frac{1}{(i\lambda)^n} dZ(\lambda)$

2. Hilbert Space Approach to the Filtering Problem

The problem is transformed into a projection problem in Hilbert space $H = L_2(\Omega,\mathcal{F},P)$:

• The optimal estimate $\hat{A}\eta$ is the projection of $A\eta$ onto the subspace $H_0(\xi_\tau^{(n)} + \eta_\tau^{(n)})$
• Satisfying two conditions:
  1. $\hat{A}\eta \in H_0(\xi_\tau^{(n)} + \eta_\tau^{(n)})$
  2. $(A\eta - \hat{A}\eta) \perp H_0(\xi_\tau^{(n)} + \eta_\tau^{(n)})$

3. Computation of Spectral Characteristics

The spectral characteristic of the optimal estimate is: $h_\tau(\lambda) = \frac{A(\lambda)(1+i\lambda)^n(-i\lambda)^n g(\lambda)}{(1+\lambda^2)^n f(\lambda) + \lambda^{2n} g(\lambda)} - \frac{(1+i\lambda)^n(-i\lambda)^n C_\tau(e^{i\lambda})}{(1-e^{i\lambda\tau})^n((1+\lambda^2)^n f(\lambda) + \lambda^{2n} g(\lambda))}$

where $C_\tau(\lambda) = \int_0^{\infty} ((P_\infty^\tau)^{-1} S_\infty^\tau a_\tau)(t) e^{i\lambda t} dt$

Minimax Robust Method

1. Basic Concept

When spectral density is incompletely known, seek the estimate that minimizes the maximum mean-square error: $\min_{h \in H_D} \max_{(f,g) \in D_f \times D_g} \Delta(h; f,g)$

2. Saddle Point Conditions

The least favorable spectral density $(f^0, g^0)$ and minimax spectral characteristic $h^0$ satisfy the saddle point inequality: $\Delta(h; f^0, g^0) \geq \Delta(h^0; f^0, g^0) \geq \Delta(h^0; f, g)$

3. Solutions for Specific Classes

Class $D_f^0 \times D_g^0$: Power Constraints

• $D_f^0 = \{f(\lambda)| \frac{1}{2\pi}\int_{-\infty}^{\infty} f(\lambda)d\lambda \leq P_1\}$
• $D_g^0 = \{g(\lambda)| \frac{1}{2\pi}\int_{-\infty}^{\infty} g(\lambda)d\lambda \leq P_2\}$

The least favorable spectral density satisfies: $|A(\lambda)(1-e^{i\lambda\tau})^n(1+\lambda^2)^n f^0(\lambda) + \lambda^{2n}C_\tau^0(\lambda)| = \alpha_1|1-e^{i\lambda\tau}|^n((1+\lambda^2)^n f^0(\lambda) + \lambda^{2n} g^0(\lambda))$

Experimental Setup

This paper is purely theoretical research, primarily employing mathematical derivations and theorem proofs to verify the correctness of the methods, without traditional numerical experiments. The paper validates theoretical results through the following approaches:

Theoretical Verification Methods

1. Rigorous Mathematical Proofs: Each major result is accompanied by complete mathematical proofs
2. Special Case Analysis: Multiple different spectral density classes are considered
3. Consistency Verification: Results are verified for consistency with classical theory

Considered Spectral Density Classes

1. Power Constraint Class $D_f^0 \times D_g^0$
2. Band Constraint Class $D_u^v \times D_\varepsilon$
3. Mixed Constraint Class: Combining power and band constraints

Main Theoretical Results

Theorem 3.1 (Optimal Filtering)

Provides complete characterization of optimal linear estimates when spectral density is known, including:

• Explicit formula for spectral characteristics (15)
• Calculation formula for mean-square error (16)
• Existence and uniqueness conditions

Theorems 5.1-5.3 (Least Favorable Spectral Density under Power Constraints)

For the power constraint class $D_f^0 \times D_g^0$, determines:

• Characterization equations for the least favorable spectral density (23)-(24)
• Explicit solutions for one-sided known cases (25)-(26)
• Calculation methods for minimax spectral characteristics

Theorems 6.1-6.3 (Least Favorable Spectral Density under Band Constraints)

For more complex constraint sets $D_u^v \times D_\varepsilon$, provides:

• Generalized characterization conditions (27)-(28)
• Least favorable spectral density in piecewise linear form
• Practical computational algorithms

Related Work

Historical Development

1. Classical Theory: Kolmogorov 11 and Wiener 33's filtering theory for stationary processes
2. Theoretical Extensions: Yaglom 36 introduced the concept of stationary increment processes
3. Robust Methods: Grenander 7 first proposed minimax methods

Recent Progress

1. Moklyachuk Series 18-27: Developed comprehensive minimax robust theory
2. Luz-Moklyachuk Collaboration 12-17: Extended theory to stationary increment processes
3. Vector Processes: Dubovetska et al. 1-5 research on periodically correlated processes

Contributions of This Paper

Compared to existing work, this paper is the first to:

• Completely solve the filtering problem for continuous-time stationary increment processes
• Provide least favorable spectral densities under multiple constraint classes
• Establish a complete framework from theory to application

Conclusions and Discussion

Main Conclusions

1. Theoretical Completeness: Establishes a complete theoretical framework for filtering problems of stationary n-th order increment processes
2. Practicality: Provides computable optimal estimation formulas and error bounds
3. Robustness: Minimax methods effectively handle spectral density uncertainty
4. Generalizability: Theory can be extended to more general classes of random processes

Limitations

1. Computational Complexity:
   • Requires solving complex integral equations (13)
   • Computation of operator $(P_\infty^\tau)^{-1}$ may be difficult
2. Condition Restrictions:
   • Minimality condition (8) may be difficult to verify in certain applications
   • Function $a_\tau(t)$ must satisfy specific integrability conditions (9)
3. Practical Applications:
   • Lack of specific numerical algorithm implementations
   • No validation with real data

Future Directions

1. Numerical Methods: Develop efficient numerical algorithms for solving integral equations
2. Application Research: Specific applications in finance, signal processing, and other fields
3. Theoretical Extensions: Generalization to multidimensional processes and nonlinear cases
4. Statistical Inference: Combine statistical methods to estimate unknown parameters

In-Depth Evaluation

Strengths

1. Theoretical Depth:
   • Rigorous mathematical derivations with complete theorem proofs
   • Strong systematic theoretical framework covering multiple cases
2. Innovation:
   • First complete solution to the filtering problem for continuous-time stationary increment processes
   • Successful application of minimax methods has methodological significance
3. Practical Value:
   • Provides operational computational formulas
   • Robust methods adapt to practical application requirements
4. Academic Contribution:
   • Enriches random process theory
   • Provides theoretical foundation for related research

Weaknesses

1. Readability Issues:
   • Dense mathematical notation, not sufficiently accessible to non-specialists
   • Lacks intuitive geometric or physical interpretations
2. Experimental Validation:
   • Pure theoretical research lacking numerical experiment verification
   • No performance comparison with existing methods
3. Application Guidance:
   • Lacks specific application cases
   • Implementation details insufficiently detailed
4. Computational Feasibility:
   • Computational complexity of certain formulas may be high
   • Lacks algorithmic complexity analysis

Impact

1. Theoretical Impact:
   • Makes important contributions to random process filtering theory
   • May inspire further related research
2. Application Prospects:
   • Potential applications in financial risk management, signal processing, and other fields
   • Provides theoretical support for practical problems
3. Reproducibility:
   • Theoretical results are reproducible
   • Practical computation requires further algorithm development

Applicable Scenarios

1. Financial Time Series: Stock prices, exchange rates, and other data with random walk characteristics
2. Signal Processing: Filtering of noisy non-stationary signals
3. Control Theory: System state estimation and prediction
4. Econometrics: Modeling and forecasting macroeconomic variables

References

The paper cites 37 important references, primarily including:

• Classical Literature: Foundational works by Kolmogorov, Wiener, Yaglom, and others
• Modern Developments: Series on minimax robust theory by Moklyachuk and colleagues
• Related Research: Recent advances in stationary increment processes and periodically correlated processes

Overall Assessment: This is a high-quality theoretical paper that makes important contributions to random process filtering theory. Although lacking numerical experiments, the completeness and innovation of the theory give it significant academic value. It has positive implications for both advancing related theoretical development and guiding practical applications.