Extremal statistics for stochastic resetting systems

Optimal conditions for first passage of jump processes with resetting

We investigate the first passage time beyond a barrier located at b≥0 of a random walk with independent and identically distributed jumps, starting from x0=0. The walk is subject to stochastic resetting, meaning that after each step the evolution is restarted with fixed probability r. We consider a resetting protocol that is an intermediate situation between a random walk (r=0) and an uncorrelated sequence of jumps all starting from the origin (r=1) and derive a general condition for determining when restarting the process with 0 Collapse

Key Words Collapse

MESH Headings Collapse

Grants Collapse

Affiliation(s)

Mattia Radice Max Planck Institute for the Physics of Complex Systems, 01187 Dresden, Germany
Giampaolo Cristadoro Dipartimento di Matematica e Applicazioni, Università degli Studi Milano-Bicocca, 20126 Milan, Italy
Samudrajit Thapa Max Planck Institute for the Physics of Complex Systems, 01187 Dresden, Germany

Collapse

Full-record statistics of one-dimensional random walks

We develop a comprehensive framework for analyzing full-record statistics, covering record counts M(t_{1}),M(t_{2}),..., their corresponding attainment times T_{M(t_{1})},T_{M(t_{2})},..., and the intervals until the next record. From this multiple-time distribution, we derive general expressions for various observables related to record dynamics, including the conditional number of records given the number observed at a previous time and the conditional time required to reach the current record given the occurrence time of the previous one. Our formalism is exemplified by a variety of stochastic processes, including biased nearest-neighbor random walks, asymmetric run-and-tumble dynamics, and random walks with stochastic resetting.

Exact fluctuation and long-range correlations in a single-file model under resetting

Resetting is a renewal mechanism in which a process is intermittently repeated after a random or fixed time. This simple act of stop and repeat profoundly influences the behavior of a system as exemplified by the emergence of nonequilibrium properties and expedition of search processes. Herein we explore the ramifications of stochastic resetting in the context of a single-file system called random average process (RAP) in one dimension. In particular, we focus on the dynamics of tracer particles and analytically compute the variance, equal time correlation, autocorrelation, and unequal time correlation between the positions of different tracer particles. Our study unveils that resetting gives rise to rather different behaviors depending on whether the particles move symmetrically or asymmetrically. For the asymmetric case, the system for instance exhibits a long-range correlation which is not seen in absence of the resetting. Similarly, in contrast to the reset-free RAP, the variance shows distinct scalings for symmetric and asymmetric cases. While for the symmetric case, it decays (towards its steady value) as ∼e^{-rt}/sqrt[t], we find ∼te^{-rt} decay for the asymmetric case (r being the resetting rate). Finally, we examine the autocorrelation and unequal time correlation in the steady state and demonstrate that they obey interesting scaling forms at late times. All our analytical results are substantiated by extensive numerical simulations.

Efficiency of a microscopic heat engine subjected to stochastic resetting

We explore the thermodynamics of stochastic heat engines in the presence of stochastic resetting. The setup comprises an engine whose working substance is a Brownian particle undergoing overdamped Langevin dynamics in a harmonic potential with a time-dependent stiffness, with the dynamics interrupted at random times with a resetting to a fixed location. The effect of resetting to the potential minimum is shown to enhance the efficiency of the engine, while the output work is shown to have a nonmonotonic dependence on the rate of resetting. The resetting events are found to drive the system out of the linear response regime, even for small differences in the bath temperatures. Shifting the reset point from the potential minimum is observed to reduce the engine efficiency. The experimental setup for the realization of such an engine is briefly discussed.

Extremal statistics for a resetting Brownian motion before its first-passage time

We study the extreme value statistics of a one-dimensional resetting Brownian motion (RBM) till its first passage through the origin starting from the position x_{0} (>0). By deriving the exit probability of RBM in an interval [0,M] from the origin, we obtain the distribution P_{r}(M|x_{0}) of the maximum displacement M and thus gives the expected value 〈M〉 of M as functions of the resetting rate r and x_{0}. We find that 〈M〉 decreases monotonically as r increases, and tends to 2x_{0} as r→∞. In the opposite limit, 〈M〉 diverges logarithmically as r→0. Moreover, we derive the propagator of RBM in the Laplace domain in the presence of both absorbing ends, and then leads to the joint distribution P_{r}(M,t_{m}|x_{0}) of M and the time t_{m} at which this maximum is achieved in the Laplace domain by using a path decomposition technique, from which the expected value 〈t_{m}〉 of t_{m} is obtained explicitly. Interestingly, 〈t_{m}〉 shows a nonmonotonic dependence on r, and attains its minimum at an optimal r^{*}≈2.71691D/x_{0}^{2}, where D is the diffusion coefficient. Finally, we perform extensive simulations to validate our theoretical results.

Ornstein-Uhlenbeck process and generalizations: Particle dynamics under comb constraints and stochastic resetting

The Ornstein-Uhlenbeck process is interpreted as Brownian motion in a harmonic potential. This Gaussian Markov process has a bounded variance and admits a stationary probability distribution, in contrast to the standard Brownian motion. It also tends to a drift towards its mean function, and such a process is called mean reverting. Two examples of the generalized Ornstein-Uhlenbeck process are considered. In the first one, we study the Ornstein-Uhlenbeck process on a comb model, as an example of the harmonically bounded random motion in the topologically constrained geometry. The main dynamical characteristics (as the first and the second moments) and the probability density function are studied in the framework of both the Langevin stochastic equation and the Fokker-Planck equation. The second example is devoted to the study of the effects of stochastic resetting on the Ornstein-Uhlenbeck process, including stochastic resetting in the comb geometry. Here the nonequilibrium stationary state is the main question in task, where the two divergent forces, namely, the resetting and the drift towards the mean, lead to compelling results in the cases of both the Ornstein-Uhlenbeck process with resetting and its generalization on the two-dimensional comb structure.

Universal Framework for Record Ages under Restart

We propose a universal framework to compute record age statistics of a stochastic time series that undergoes random restarts. The proposed framework makes minimal assumptions on the underlying process and is furthermore suited to treat generic restart protocols going beyond the Markovian setting. After benchmarking the framework for classical random walks on the 1D lattice, we derive a universal criterion underpinning the impact of restart on the age of the nth record for generic time series with nearest-neighbor transitions. Crucially, the criterion contains a penalty of order n that puts strong constraints on restart expediting the creation of records, as compared to the simple first-passage completion. The applicability of our approach is further demonstrated on an aggregation-shattering process where we compute the typical growth rates of aggregate sizes. This unified framework paves the way to explore record statistics of time series under restart in a wide range of complex systems.

Time to reach the maximum for a stationary stochastic process

We consider a one-dimensional stationary time series of fixed duration T. We investigate the time t_{m} at which the process reaches the global maximum within the time interval [0,T]. By using a path-decomposition technique, we compute the probability density function P(t_{m}|T) of t_{m} for several processes, that are either at equilibrium (such as the Ornstein-Uhlenbeck process) or out of equilibrium (such as Brownian motion with stochastic resetting). We show that for equilibrium processes the distribution of P(t_{m}|T) is always symmetric around the midpoint t_{m}=T/2, as a consequence of the time-reversal symmetry. This property can be used to detect nonequilibrium fluctuations in stationary time series. Moreover, for a diffusive particle in a confining potential, we show that the scaled distribution P(t_{m}|T) becomes universal, i.e., independent of the details of the potential, at late times. This distribution P(t_{m}|T) becomes uniform in the "bulk" 1≪t_{m}≪T and has a nontrivial universal shape in the "edge regimes" t_{m}→0 and t_{m}→T. Some of these results have been announced in a recent letter [Europhys. Lett. 135, 30003 (2021)0295-507510.1209/0295-5075/ac19ee].

Entropy rate of random walks on complex networks under stochastic resetting

Stochastic processes under resetting at random times have attracted a lot of attention in recent years and served as illustrations of nontrivial and interesting static and dynamic features of stochastic dynamics. In this paper, we aim to address how the entropy rate is affected by stochastic resetting in discrete-time Markovian processes, and we explore nontrivial effects of the resetting in the mixing properties of a stochastic process. In particular, we consider resetting random walks (RRWs) with a single resetting node on three different types of networks: degree-regular random networks, a finite-size Cayley tree, and a Barabási-Albert (BA) scale-free network, and we compute the entropy rate as a function of the resetting probability γ. Interestingly, for the first two types of networks, the entropy rate shows a nonmonotonic dependence on γ. There exists an optimal value of γ at which the entropy rate reaches a maximum. Such a maximum is larger than that of maximal-entropy random walks (MREWs) and standard random walks (SRWs) on the same topology, while for the BA network the entropy rate of RRWs either shows a unique maximum or decreases monotonically with γ, depending upon the choice of the resetting node. When the maximum entropy rate of RRWs exists, it can be higher or lower than that of MREWs or SRWs. Our study reveals a nontrivial effect of stochastic resetting on nonequilibrium statistical physics.

Random walks on complex networks under time-dependent stochastic resetting

We study discrete-time random walks on networks subject to a time-dependent stochastic resetting, where the walker either hops randomly between neighboring nodes with a probability 1-ϕ(a) or is reset to a given node with a complementary probability ϕ(a). The resetting probability ϕ(a) depends on the time a since the last reset event (also called a, the age of the walker). Using the renewal approach and spectral decomposition of the transition matrix, we formulate the stationary occupation probability of the walker at each node and the mean first passage time between two arbitrary nodes. Concretely, we consider two different time-dependent resetting protocols that are both exactly solvable. One is that ϕ(a) is a step-shaped function of a and the other one is that ϕ(a) is a rational function of a. We demonstrate the theoretical results on several different networks, also validated by numerical simulations, and find that the time-modulated resetting protocols can be more advantageous than the constant-probability resetting in accelerating the completion of a target search process.

Extreme value statistics and arcsine laws for heterogeneous diffusion processes

Heterogeneous diffusion with a spatially changing diffusion coefficient arises in many experimental systems such as protein dynamics in the cell cytoplasm, mobility of cajal bodies, and confined hard-sphere fluids. Here, we showcase a simple model of heterogeneous diffusion where the diffusion coefficient D(x) varies in a power-law way, i.e., D(x)∼|x|^{-α} with the exponent α>-1. This model is known to exhibit anomalous scaling of the mean-squared displacement (MSD) of the form ∼t^{2/2+α} and weak ergodicity breaking in the sense that ensemble averaged and time averaged MSDs do not converge. In this paper, we look at the extreme value statistics of this model and derive, for all α, the exact probability distributions of the maximum spatial displacement M(t) and arg-maximum t_{m}(t) (i.e., the time at which this maximum is reached) till duration t. In the second part of our paper, we analyze the statistical properties of the residence time t_{r}(t) and the last-passage time t_{ℓ}(t) and compute their distributions exactly for all values of α. Our study unravels that the heterogeneous version (α≠0) displays many rich and contrasting features compared to that of the standard Brownian motion (BM). For example, while for BM (α=0), the distributions of t_{m}(t),t_{r}(t), and t_{ℓ}(t) are all identical (á la "arcsine laws" due to Lévy), they turn out to be significantly different for nonzero α. Another interesting property of t_{r}(t) is the existence of a critical α (which we denote by α_{c}=-0.3182) such that the distribution exhibits a local maximum at t_{r}=t/2 for α<α_{c} whereas it has minima at t_{r}=t/2 for α≥α_{c}. The underlying reasoning for this difference hints at the very contrasting natures of the process for α≥α_{c} and α<α_{c} which we thoroughly examine in our paper. All our analytical results are backed by extensive numerical simulations.

Time averaging and emerging nonergodicity upon resetting of fractional Brownian motion and heterogeneous diffusion processes

How different are the results of constant-rate resetting of anomalous-diffusion processes in terms of their ensemble-averaged versus time-averaged mean-squared displacements (MSDs versus TAMSDs) and how does stochastic resetting impact nonergodicity? We examine, both analytically and by simulations, the implications of resetting on the MSD- and TAMSD-based spreading dynamics of particles executing fractional Brownian motion (FBM) with a long-time memory, heterogeneous diffusion processes (HDPs) with a power-law space-dependent diffusivity D(x)=D_{0}|x|^{γ} and their "combined" process of HDP-FBM. We find, inter alia, that the resetting dynamics of originally ergodic FBM for superdiffusive Hurst exponents develops disparities in scaling and magnitudes of the MSDs and mean TAMSDs indicating weak ergodicity breaking. For subdiffusive HDPs we also quantify the nonequivalence of the MSD and TAMSD and observe a new trimodal form of the probability density function. For reset FBM, HDPs and HDP-FBM we compute analytically and verify by simulations the short-time MSD and TAMSD asymptotes and long-time plateaus reminiscent of those for processes under confinement. We show that certain characteristics of these reset processes are functionally similar despite a different stochastic nature of their nonreset variants. Importantly, we discover nonmonotonicity of the ergodicity-breaking parameter EB as a function of the resetting rate r. For all reset processes studied we unveil a pronounced resetting-induced nonergodicity with a maximum of EB at intermediate r and EB∼(1/r)-decay at large r. Alongside the emerging MSD-versus-TAMSD disparity, this r-dependence of EB can be an experimentally testable prediction. We conclude by discussing some implications to experimental systems featuring resetting dynamics.

Geometric Brownian motion under stochastic resetting: A stationary yet nonergodic process

We study the effects of stochastic resetting on geometric Brownian motion with drift (GBM), a canonical stochastic multiplicative process for nonstationary and nonergodic dynamics. Resetting is a sudden interruption of a process, which consecutively renews its dynamics. We show that, although resetting renders GBM stationary, the resulting process remains nonergodic. Quite surprisingly, the effect of resetting is pivotal in manifesting the nonergodic behavior. In particular, we observe three different long-time regimes: a quenched state, an unstable state, and a stable annealed state depending on the resetting strength. Notably, in the last regime, the system is self-averaging and thus the sample average will always mimic ergodic behavior establishing a stand-alone feature for GBM under resetting. Crucially, the above-mentioned regimes are well separated by a self-averaging time period which can be minimized by an optimal resetting rate. Our results can be useful to interpret data emanating from stock market collapse or reconstitution of investment portfolios.

First passage under restart for discrete space and time: Application to one-dimensional confined lattice random walks

First passage under restart has recently emerged as a conceptual framework to study various stochastic processes under restart mechanism. Emanating from the canonical diffusion problem by Evans and Majumdar, restart has been shown to outperform the completion of many first-passage processes which otherwise would take longer time to finish. However, most of the studies so far assumed continuous time underlying first-passage time processes and moreover considered continuous time resetting restricting out restart processes broken up into synchronized time steps. To bridge this gap, in this paper, we study discrete space and time first-passage processes under discrete time resetting in a general setup without specifying their forms. We sketch out the steps to compute the moments and the probability density function which is often intractable in the continuous time restarted process. A criterion that dictates when restart remains beneficial is then derived. We apply our results to a symmetric and a biased random walker in one-dimensional lattice confined within two absorbing boundaries. Numerical simulations are found to be in excellent agreement with the theoretical results. Our method can be useful to understand the effect of restart on the spatiotemporal dynamics of confined lattice random walks in arbitrary dimensions.