DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación
Artículo científico (JournalArticle)
Numerical methods for quasi-stationary distributions
In stochastic processes with absorbing states, the quasi-stationary distribution provides valuable insights into the long-term behavior prior to absorption. In this work, we revisit two well-established numerical methods for its computation. The first is an iterative algorithm for solving the nonlinear equation that defines the quasi-stationary distribution. We generalize this technique to accommodate general Markov stochastic processes, either with discrete or continuous state space, and with multiple absorbing states. The second is a Monte Carlo method with resetting, for which we propose a single-trajectory approach that uses the trajectory's own history to perform resets after absorption. In addition to these methodological contributions, we provide a detailed analysis of implementation aspects for both methods. We also compare their accuracy and efficiency across a range of examples. The results indicate that the iterative algorithm is generally the preferred choice for problems with simple boundaries, while the Monte Carlo approach is more suitable for problems with complex boundaries, where the implementation of the iterative algorithm is a challenging task., Partial financial support has been received from Grants No. PID2021-122256NB-C21/C22 and No. PID2024-157493NB-C21/C22 funded by MICIU/AEI/10.13039/501100011033 and ERDF/EU, and the María de Maeztu Program for units of Excellence in R&D, Grant No. CEX2021-001164-M. S.O-B. acknowledges support from the Spanish Ministry of Education and Professional Training under the Grant No. FPU21/04997., With funding from the Spanish government through the "Maria de Maeztu Centre of Excellence" accreditation (CEX2021-001164-M)., Peer reviewed
Proyecto:
AEI / FPU21 04997
,
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 CEX2021-001164-M
,
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 PID2021-122256NB-C21
,
AEI / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 PID2021-122256NB-C22
,
AEI PID2024-157493NB-C21
,
PID2024-157493NB-C22