On weak convergence of Gaussian conditional distributions

Basic Information

• Paper ID: 2510.12412
• Title: On weak convergence of Gaussian conditional distributions
• Authors: Sarah Lumpp, Mathias Drton
• Classification: math.ST stat.TH
• Publication Date: October 14, 2025 (arXiv preprint)
• Paper Link: https://arxiv.org/abs/2510.12412

Abstract

Weak convergence of joint distributions does not generally imply convergence of conditional distributions. In particular, when joint Gaussian distributions converge to a singular Gaussian limit, the conditional distributions need not converge. From an algebraic perspective, this occurs because the Schur complement is not a continuous function of matrix elements at singular covariance matrices. The results in this paper elucidate special conditions under which Gaussian conditional distributions still converge, and illustrate how this enables reasoning about conditional independence in a new class of graphical models.

Research Background and Motivation

Core Problem

The core problem addressed in this research is: when a sequence of Gaussian distributions $X^{(m)} \sim N(0, Σ^{(m)})$ converges weakly to a singular Gaussian distribution $X \sim N(0, Σ)$, whether the conditional distributions $N(0, Σ_{R|S}^{(m)})$ converge to $N(0, Σ_{R|S})$.

Problem Significance

1. Theoretical Importance: The convergence of conditional distributions is a fundamental problem in probability theory, crucial for understanding the limiting behavior of distributions
2. Applied Value: In graphical models, the analysis of conditional independence relies on properties of conditional distributions, particularly in novel graphical models defined by continuous Lyapunov equations

Limitations of Existing Methods

1. Discontinuity in General Cases: The pseudoinverse operation $(·)^+$ is discontinuous at singular matrices, causing the conditional covariance matrix $Σ_{R|S} = Σ_{R,R} - Σ_{R,S}(Σ_{S,S})^+Σ_{S,R}$ to potentially diverge
2. Restrictions in Special Cases: Known results primarily apply to matrix sequences of constant rank, while practical applications frequently encounter full-rank matrices converging to singular matrices

Research Motivation

Inspired by Boege et al. (2025) on conditional independence, the authors consider the more challenging case where each $Σ^{(m)}$ is full-rank while the limiting covariance matrix $Σ$ is singular.

Core Contributions

1. Establishing Convergence Conditions: Proposes sufficient conditions for convergence of Gaussian conditional distributions, even in singular limit cases
2. Generalization of Matrix Determinant Lemma: Develops an extended version of the matrix determinant lemma for analyzing asymptotic behavior of singular matrices
3. Graphical Model Applications: Demonstrates how to apply theoretical results to conditional independence analysis in graphical models defined by continuous Lyapunov equations
4. Special Case for Toeplitz Matrices: Provides intuitive alternative proofs for special Toeplitz matrices

Methodology Details

Problem Formulation

Given a sequence of Gaussian random vectors $X^{(m)} \sim N(0, Σ^{(m)})$ converging weakly to $X \sim N(0, Σ)$, where $Σ^{(m)}$ is invertible but $Σ$ is singular. For disjoint subsets $S, R ⊆ [p]$, determine whether the conditional covariance matrices $Σ_{R|S}^{(m)}$ converge to $Σ_{R|S}$.

Core Theoretical Results

Main Theorem (Theorem 1.2)

Let $Σ^{(m)}$ be a sequence of invertible symmetric $p×p$ matrices with singular limit $Σ$, satisfying the expansion: $Σ^{(m)} = Σ + \frac{1}{m}Σ^{(1,∞)} + o\left(\frac{1}{m}\right)$

For $S ⊂ [p]$ with $k = |S| < p$, $R = [p] \setminus S$, if matrices $Σ$ and $Σ^{(1,∞)}$ satisfy:

(i) $f(U, Σ_{S,S}^{(1,∞)}) ≠ 0$, where $U$ comes from the symmetric rank decomposition $Σ_{S,S} = UBU^T$
(ii) $\text{im}(Σ_{S,R}) ⊆ \text{im}(Σ_{S,S})$

then the conditional covariance matrices $Σ_{R|S}^{(m)}$ converge to $Σ_{R|S}$.

Key Function Definition

The function $f: \mathbb{R}^{k×r} × \mathbb{R}^{k×k} → \mathbb{R}$ is defined as: $f(U,G) = (-1)^{s([k-r])} \sum_{\substack{α⊆[k] \\ |α|=k-r}} (-1)^{s(α)} \det\begin{pmatrix} G_{[k],α} & U \end{pmatrix} \det(U_{[k]\setminus α,[r]})$

Technical Innovations

1. Generalization of Matrix Determinant Lemma

Lemma 3.1: For matrices $U, V ∈ \mathbb{R}^{k×r}$, $G ∈ \mathbb{R}^{k×k}$, $B ∈ \mathbb{R}^{r×r}$, where $r < k$: $\det\left(UBV^T + \frac{1}{m}G\right) = \frac{1}{m^{k-r}} \cdot \det(B) \cdot f_{\text{asy}}(U, V, G) + o\left(\frac{1}{m^{k-r}}\right)$

2. Application of Cramer's Rule

By expressing each element of the conditional covariance matrix as: $v_m^T A_m^{-1} w_m = \frac{\det(A_m[j])}{\det(A_m)}$ and analyzing the asymptotic behavior of numerators and denominators to establish convergence.

3. Noise Handling

Lemma 3.2 addresses the impact of additional noise terms $D^{(m)} = o(1/m)$, ensuring that main asymptotic terms remain unaffected.

Experimental Setup

Application Scenario: Continuous Lyapunov Equation

Consider Gaussian distributions satisfying the continuous Lyapunov equation: $MΣ + ΣM^T + 2I_p = 0$ where $M$ is a stable matrix whose zero pattern encodes the graph structure.

Concrete Examples

Example 2.1: Trek $T_4: 1 ← 2 → 3 → 4$

Construct the stable matrix: