On time-consistent equilibrium stopping under aggregation of diverse discount rates

Basic Information

• Paper ID: 2302.07470
• Title: On time-consistent equilibrium stopping under aggregation of diverse discount rates
• Authors: Shuoqing Deng (Hong Kong University of Science and Technology), Xiang Yu (Hong Kong Polytechnic University), Jiacheng Zhang (Chinese University of Hong Kong)
• Classification: q-fin.MF (Mathematical Finance), math.OC (Optimization and Control)
• Publication Date: February 2023 (arXiv version)
• Paper Link: https://arxiv.org/abs/2302.07470

Abstract

This paper investigates the problem of a central planner making decisions on behalf of group members with heterogeneous discount rates. In the context of optimal stopping, aggregated preferences are employed to integrate all discount rates through an attitude function that reflects the central planner's choices. The problem formulation also applies to single-agent stopping problems with uncertain discount rates, where aggregated preferences align with traditional smooth ambiguity preferences. The resulting optimal stopping problem exhibits time inconsistency, for which an iterative method using consistent planning is developed. All time-consistent mild equilibria in one-dimensional diffusion settings are characterized as fixed points of a carefully defined operator. The paper provides sufficient conditions on the underlying model and attitude function ensuring that the minimal mild equilibrium achieves optimality. Furthermore, it is shown that the optimal equilibrium is a weak equilibrium. When the sufficient conditions on the attitude function are violated, various examples illustrate that the characterization of optimal equilibria may differ significantly from existing single-agent results, now sensitively depending on the attitude function and the diversity distribution of discount rates within the group.

Research Background and Motivation

Problem Background

1. Realism of heterogeneous discount rates: Experimental studies demonstrate that individuals exhibit heterogeneous discount rates when evaluating long-term profits and costs. Weitzman (2001) surveyed numerous economists regarding discount rates for long-term projects (such as climate change mitigation proposals), finding an average response of 3.96% with a standard deviation of 2.94%, revealing widespread disagreement on discount rates.
2. Challenges in collective decision-making: How to coordinate social or group decision-making when facing widespread disagreement is an important and challenging problem in many financial and economic applications. Individuals hold divergent views on a broad range of topics, from future economic growth rates and profitability of new technologies to global warming risks.
3. Limitations of existing approaches:
   • Pareto efficiency-based approaches are dictatorial, effectively equivalent to selecting the time preferences of only one group member
   • Aggregation rules respecting consensus and heterogeneous discount rates are typically shown to be time-inconsistent

Research Motivation

This paper aims to address time inconsistency in dynamic decision-making by embracing all heterogeneous discount rates of group members within the context of optimal stopping.

Core Contributions

1. Proposes an aggregated preferences framework: Introduces an aggregated preference scheme in optimal stopping problems that respects and integrates heterogeneous discount rates from all group members, allowing the central planner to select an attitude function reflecting weights on different discount rate levels.
2. Develops an iterative method: Develops an iterative method for time-inconsistent optimal stopping problems, characterizing all time-consistent equilibrium stopping strategies in one-dimensional diffusion settings as fixed points of a carefully defined operator.
3. Establishes conditions for optimal equilibrium existence: Provides sufficient conditions on the underlying model and attitude function ensuring the existence of a unique optimal equilibrium whose value function dominates those under all other equilibria in the put payoff case.
4. Reveals the impact of attitude functions: Through concrete examples, demonstrates how the attitude function φ(x) and the distribution of stochastic discount rates significantly distort the characterization of optimal equilibria, finding that optimal equilibria may not exist in certain cases.

Methodology Details

Problem Formulation

Studies the infinite-horizon optimal stopping problem: $\sup_{\tau \in \mathcal{T}} \int_0^{\infty} \varphi\left(E[e^{-r\tau}g(X_\tau^x)]\right) dF_\rho(r)$

where:

• $(X_t^x)_{t \geq 0}$ is the underlying state process with initial value $X_0^x = x$
• $g(x)$ is the payoff function
• $\varphi(x)$ is the attitude function
• $F_\rho(r)$ is the distribution function of discount rate $\rho$

Model Architecture

1. Aggregated Preferences Design

Employs aggregated preferences similar to smooth ambiguity preferences of Klibanoff et al. (2005, 2009): $\int_{\Delta} \varphi\left(\int_S u(f)d\pi\right) d\mu$

where the attitude function $\varphi(\cdot)$ characterizes the aggregation rule for different expected utility values.

2. Time-Consistency Framework

Due to the nonlinearity of double expectations, the optimal stopping problem lacks time consistency. Adopts consistent planning proposed by Strotz (1956): the agent selects the best current action today by treating future compliance as a constraint.

3. Policy Improvement Operator

Defines the policy improvement operator $\Theta(\cdot)$: $\Theta(R) := S_R \cup (I_R \cap R)$

where:

• $S_R := \{x \in \mathbb{R} : \varphi(g(x)) > J(x,R)\}$ (stopping region)
• $I_R := \{x \in \mathbb{R} : \varphi(g(x)) = J(x,R)\}$ (indifference region)
• $C_R := \{x \in \mathbb{R} : \varphi(g(x)) < J(x,R)\}$ (continuation region)

Technical Innovations

1. Nonlinear aggregation handling: Unlike linear aggregation $\varphi(x) = x$, this paper addresses general attitude functions that cannot be simplified to a single expectation, requiring development of new iterative methods.
2. Fixed-point characterization: Characterizes time-consistent equilibria as fixed points of operators, proving convergence of iterations starting from arbitrary initial stopping strategies.
3. Optimal equilibrium identification: Provides sufficient conditions for identifying optimal equilibria, particularly in the put payoff function case.

Theoretical Results

Main Theorems

Theorem 3.1 (Equilibrium Characterization)

The equilibrium set $\mathcal{E}$ can be characterized as: $\mathcal{E} = \left\{\lim_{n \to \infty} \Theta^n(R) = \bigcup_{n=0}^{\infty} \Theta^n(R) : R \in \mathcal{B}(\mathbb{R})\right\}$

Theorem 4.8 (Optimal Equilibrium Existence)

Assume conditions C-(i) through C-(iii) hold. There exists $a^* \geq 0$ such that the stopping region $[0,a]$ is a time-consistent equilibrium if and only if $a \geq a^*$. Furthermore, the equilibrium $[0,a^*]$ is the optimal equilibrium.

Sufficient Conditions

Condition C-(i): $\mu(x) \geq 0$ for all $x \geq 0$

Condition C-(ii): Technical conditions on the underlying diffusion process, including:

1. $\varphi_1'(x) < 0$ and $\limsup_{x \to \infty} \frac{\mu(x)+1}{\sigma^2(x)} < \infty$
2. $I_1 = I_2 = +\infty$

Condition C-(iii): The attitude function $\varphi(x)$ is $C^1$ and satisfies that $\varphi'(x)x$ is increasing, with $\varphi(x)$ strictly increasing

Experimental Results

Geometric Brownian Motion Example

For $dX_t = \mu X_t dt + \sigma X_t dW_t$, the optimal equilibrium threshold is: $a^* = \frac{\int_0^{\infty} f(r) dF_\rho(r)}{1 + \int_0^{\infty} f(r) dF_\rho(r)} K$

where $f(r) = \frac{\mu}{\sigma^2} - \frac{1}{2} + \sqrt{\left(\frac{\mu}{\sigma^2} - \frac{1}{2}\right)^2 + \frac{2r}{\sigma^2}}$

Bessel Process Example

For the three-dimensional Bessel process $X_t = \sqrt{(W_t^1)^2 + (W_t^2)^2 + (W_t^3)^2}$, the optimal equilibrium threshold satisfies: $a^* = \frac{\int_0^{\infty} \sqrt{2r} dF_\rho(r) K - 2 + \sqrt{4 + \left(\int_0^{\infty} \sqrt{2r} dF_\rho(r)\right)^2 K^2}}{2\int_0^{\infty} \sqrt{2r} dF_\rho(r)}$

Impact of Non-Standard Attitude Functions

When $\varphi(x) = \min(x, \alpha)$, the following findings emerge:

1. If $\alpha$ is sufficiently large, the optimal equilibrium remains the minimal equilibrium
2. For certain small values of $\alpha$, the optimal equilibrium exists but differs from the minimal equilibrium
3. For certain values of $\alpha$, the optimal equilibrium does not exist

Related Work

Time-Inconsistent Stopping Problems

• Huang and Nguyen-Huu (2018) developed iterative methods for non-exponential discounting
• Bayraktar et al. (2021, 2023) studied different time-consistent equilibrium concepts
• Christensen and Lindensjö (2018, 2020) employed extended HJB equation approaches

Aggregation of Heterogeneous Preferences

• Ebert et al. (2020) studied linear aggregation rules $\varphi(x) = x$
• Jackson and Yariv (2015), Millner and Heal (2018) demonstrated time inconsistency of aggregation rules

Model Uncertainty

The paper's aggregated preferences align with smooth ambiguity preferences of Klibanoff et al. (2005, 2009), applicable to optimal control problems under model uncertainty.

Conclusions and Discussion

Main Conclusions

1. Successfully develops a theory of time-consistent equilibria addressing aggregation of heterogeneous discount rates
2. Provides sufficient conditions for optimal equilibrium existence and characterization
3. Reveals the sensitive impact of attitude functions on optimal equilibria

Limitations

1. Theoretical results are primarily restricted to one-dimensional diffusion processes
2. General characterization of optimal equilibria remains an open question
3. Optimal equilibria may not exist in certain cases

Future Directions

1. Extension to multi-dimensional diffusion processes
2. Development of general characterization methods for optimal equilibria
3. Investigation of other types of payoff functions

In-Depth Evaluation

Strengths

1. Theoretical innovation: First systematic study of time-consistent optimal stopping with heterogeneous discount rates
2. Complete methodology: Develops comprehensive iterative methods and equilibrium characterization theory
3. Practical relevance: Problem formulation has significant practical application value
4. In-depth analysis: Thoroughly analyzes the impact of attitude functions through concrete examples

Weaknesses

1. Technical limitations: Main results restricted to one-dimensional diffusion processes, limiting applicability
2. Complex conditions: Sufficient conditions are highly technical, making practical verification potentially difficult
3. Optimality characterization: Lacks general characterization of optimal equilibria when attitude function conditions C-(iii) are violated

Impact

1. Theoretical contribution: Provides new perspectives and tools for time-inconsistent optimal stopping theory
2. Application value: Provides theoretical foundation for practical problems such as government budget decisions and capital investment
3. Future research: Establishes foundation for further research in related fields

Applicable Scenarios

1. Government decision-making on long-term investments representing different age groups
2. Corporate capital budgeting problems facing uncertain discount rates
3. Financial institutions' risk management and portfolio optimization
4. Cost-benefit analysis of long-term policies such as climate change

References

• Huang, Y. and A. Nguyen-Huu (2018). Time-consistent stopping under decreasing impatience. Finance and Stochastics, 22(1): 69-95.
• Klibanoff, P., M. Marinacci, and S. Mukerji (2005). A smooth model of decision making under ambiguity. Econometrica, 73(6): 1849-1892.
• Weitzman, M. L. (2001). Gamma discounting. American Economic Review, 91(1): 260-271.
• Ebert, S., W. Wei and X. Y. Zhou (2020). Weighted discounting–On group diversity, time inconsistency, and consequences for investment. Journal of Economic Theory, 189: 105089.