Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 19
Encontrada(s) 1 página(s)

Investigo. Repositorio Institucional de la Universidade de Vigo
Publication Artículo científico (JournalArticle)

A protocol for dynamic model calibration

  • Fernandez Villaverde, Alejandro
  • Pathirana, Dilan
  • Fröhlich, Fabian
  • Hasenauer, Jan
  • Banga, Julio R.
Financiado para publicación en acceso aberto: Universidade de Vigo/CISUG, Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and nonmeasurable parameters, which have to be determined by fitting the model to experimental data. In order to perform this task, known as parameter estimation or model calibration, the modeller faces challenges such as poor parameter identifiability, lack of sufficiently informative experimental data and the existence of local minima in the objective function landscape. These issues tend to worsen with larger model sizes, increasing the computational complexity and the number of unknown parameters. An incorrectly calibrated model is problematic because it may result in inaccurate predictions and misleading conclusions. For nonexpert users, there are a large number of potential pitfalls. Here, we provide a protocol that guides the user through all the steps involved in the calibration of dynamic models. We illustrate the methodology with two models and provide all the code required to reproduce the results and perform the same analysis on new models. Our protocol provides practitioners and researchers in biological modelling with a one-stop guide that is at the same time compact and sufficiently comprehensive to cover all aspects of the problem, MCIN/AEI/ 10.13039/501100011033 | Ref. PID2020-117271RB-C2, MCIN/AEI/ 10.13039/501100011033 | Ref. DPI2017-82896-C2-2-R, MCIN/AEI/10.13039/501100011033 | Ref. RYC-2019-027537-I, Xunta de Galicia | Ref. ED431F 2021/003
Investigo. Repositorio Institucional de la Universidade de Vigo
Publication Artículo científico (JournalArticle)

Assessment of prediction uncertainty quantification methods in systems Biology

  • Fernandez Villaverde, Alejandro
  • Banga, Julio R.
  • Raimúndez, Elba
  • Hasenauer, Jan
Biological processes are often modelled using ordinary differential equations. The unknown parameters of these models are estimated by optimizing the fit of model simulation and experimental data. The resulting parameter estimates inevitably possess some degree of uncertainty. In practical applications it is important to quantify these parameter uncertainties as well as the resulting prediction uncertainty, which are uncertainties of potentially time-dependent model characteristics. Unfortunately, estimating prediction uncertainties accurately is nontrivial, due to the nonlinear dependence of model characteristics on parameters. While a number of numerical approaches have been proposed for this task, their strengths and weaknesses have not been systematically assessed yet. To fill this knowledge gap, we apply four state of the art methods for uncertainty quantification to four case studies of different computational complexities. This reveals the trade-offs between their applicability and their statistical interpretability. Our results provide guidelines for choosing the most appropriate technique for a given problem and applying it successfully., Xunta de Galicia | Ref. ED431F 2021/003, Agencia Estatal de Investigación | Ref. RYC-2019-027537-I, Agencia Estatal de Investigación | Ref. PID2020-117271RB-C2, Universidade de Vigo/CISUG
Investigo. Repositorio Institucional de la Universidade de Vigo
Publication Artículo científico (JournalArticle)

Structural identifiability of dynamic systems biology models

  • Fernández Villaverde, Alejandro
  • Barreiro Blas, Antonio
  • Papachristodoulou, Antonis
A powerful way of gaining insight into biological systems is by creating a nonlinear differential equation model, which usually contains many unknown parameters. Such a model is called structurally identifiable if it is possible to determine the values of its parameters from measurements of the model outputs. Structural identifiability is a prerequisite for parameter estimation, and should be assessed before exploiting a model. However, this analysis is seldom performed due to the high computational cost involved in the necessary symbolic calculations, which quickly becomes prohibitive as the problem size increases. In this paper we show how to analyse the structural identifiability of a very general class of nonlinear models by extending methods originally developed for studying observability. We present results about models whose identifiability had not been previously determined, report unidentifiabilities that had not been found before, and show how to modify those unidentifiable models to make them identifiable. This method helps prevent problems caused by lack of identifiability analysis, which can compromise the success of tasks such as experiment design, parameter estimation, and model-based optimization. The procedure is called STRIKE-GOLDD (STRuctural Identifiability taKen as Extended-Generalized Observability with Lie Derivatives and Decomposition), and it is implemented in a MATLAB toolbox which is available as open source software. The broad applicability of this approach facilitates the analysis of the increasingly complex models used in systems biology and other areas., Xunta de Galicia | Ref. ED481B 2014/133, Ministerio de Economía y Competitividad | Ref. DPI2013-47100-C2-2- P, Engineering and Physical Sciences Research Council (Reino Unido) | Ref. EP/M002454/1, Engineering and Physical Sciences Research Council (Reino Unido) | Ref. EP/J012041/1
RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Análisis de observabilidad e identificabilidad estructural de modelos no lineales: aplicación a la vía de señalización JAK/STAT, Structural Identifiability and Observability Analysis of a JAK/STAT Signalling Pathway Model

  • Villaverde, Alejandro
  • Banga, Julio R.
[Resumen] La observabilidad e identificabilidad estructural son propiedades que se corresponden con la posibilidad teórica de determinar los vectores de estado y de parámetros de un modelo a partir de su salida. Recientemente hemos desarrollado una herramienta MATLAB, STRIKE-GOLDD, que analiza la observabilidad e identificabilidad estructural local de modelos no lineales de ecuaciones diferenciales ordinarias empleando una metodología simbólica. Si bien STRIKE-GOLDD es una metodología de propósito general, su desarrollo está motivado por el estudio de modelos biológicos, para los que estos análisis son de especial relevancia. En este trabajo se analiza la observabilidad e identificabilidad estructural de un modelo dinámico de la vía de señalización celular JAK/STAT. Este sistema de transducción de señales juega un papel importante en procesos de inmunidad, proliferación y división celular, apoptosis y oncogénesis. Usando este modelo de relevancia biomédica como caso de estudio, el presente trabajo proporciona un tutorial sobre el uso de STRIKEGOLDD, ilustrando sus capacidades y limitaciones., [Abstract] Observability and structural identifiability are classic systemic properties that describe whether it is theoretically possible to determine the state and parameter vectors of a model from its output. Recently we developed a MATLAB tool, STRIKE-GOLDD, which adopts a symbolic approach for analysing observability and structural identifiability of nonlinear ODE models. While being a general purpose tool, the motivation behind the development of STRIKE-GOLDD was the study of biological models, for which these analyses can provide very valuable insight. This paper demonstrates the application of STRIKE-GOLDD to a dynamic model of the JAK/STAT signaling pathway, which plays an important role in processes such as immunity, cell division, cell death and tumour formation. Using this model of biomedical relevance as a case study, the present paper provides a tutorial on the use of the STRIKE-GOLDD methodology, highlighting its capabilities and limitations., Ministerio de Ciencia, Innovación y Universidades; SYNBIOCONTROL (DPI2017-82896-C2-2-R)
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

PREMER: parallel reverse engineering of biological networks with information theory

  • Villaverde, A. F.
  • Becker, Kolja
  • Banga, Julio R.
7 páginas, 3 figuras.-- 14th International Conference, CMSB 2016, Cambridge, UK, September 21-23, 2016, Proceedings, A common approach for reverse engineering biological networks from data is to deduce the existence of interactions among nodes from information theoretic measures. Estimating these quantities in a multidimensional space is computationally demanding for large datasets. This hampers the application of elaborate algorithms – which are crucial for discarding spurious interactions and determining causal relationships – to large-scale network inference problems. To alleviate this issue we have developed PREMER, a software tool which can automatically run in parallel and sequential environments, thanks to its implementation of OpenMP directives. It recovers network topology and estimates the strength and causality of interactions using information theoretic criteria, and allowing the incorporation of prior knowledge. A preprocessing module takes care of imputing missing data and correcting outliers if needed. PREMER (https://​sites.​google.​com/​site/​premertoolbox/​) runs on Windows, Linux and OSX, it is implemented in Matlab/Octave and Fortran 90, and it does not require any commercial software, AFV acknowledges funding from the Galician government (Xunta de Galiza) through the I2C fellowship ED481B2014/133-0. KB was supported by the German Federal Ministry of Research and Education (BMBF, OncoPath consortium). JRB acknowledges funding from the Spanish government (MINECO) and the European Regional Development Fund (ERDF) through the project \SYN- BIOFACTORY" (grant number DPI2014-55276-C5-2-R). This project has received funding from the European Unions Horizon 2020 research and innovation programme under grant agreement No 686282 (CanPathPro)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

On the relationship between sloppiness and identifiability

  • Chis, O.
  • Villaverde, A. F.
  • Banga, Julio R.
  • Balsa-Canto, Eva
25 páginas, 11 figuras, 2 tablas, Dynamic models of biochemical networks are often formulated as sets of non-linear ordinary differential equations, whose states are the concentrations or abundances of the network components. They typically have a large number of kinetic parameters, which must be determined by calibrating the model with experimental data. In recent years it has been suggested that dynamic systems biology models are universally sloppy, meaning that the values of some parameters can be perturbed by several orders of magnitude without causing significant changes in the model output. This observation has prompted calls for focusing on model predictions rather than on parameters. In this work we examine the concept of sloppiness, investigating its links with the long-established notions of structural and practical identifiability. By analysing a set of case studies we show that sloppiness is not equivalent to lack of identifiability, and that sloppy models can be identifiable. Thus, using sloppiness to draw conclusions about the possibility of estimating parameter values can be misleading. Instead, structural and practical identifiability analyses are better tools for assessing the confidence in parameter estimates. Furthermore, we show that, when designing new experiments to decrease parametric uncertainty, designs that optimize practical identifiability criteria are more informative than those that minimize sloppiness, This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 686282 (“CANPATHPRO”) and from the Spanish government (MINECO) and the European Regional Development Fund (ERDF) through the projects “SYNBIOFACTORY” (grant number DPI2014-55276-C5-2-R), and “IMPROWINE” (grant number AGL2015-67504-C3-2-R), No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Structural identifiability of dynamic systems biology models

  • Villaverde, A. F.
  • Barreiro, Antonio
  • Papachristodoulou, Antonis
22 páginas, 5 figuras, 2 tablas.-- This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited., A powerful way of gaining insight into biological systems is by creating a nonlinear differential equation model, which usually contains many unknown parameters. Such a model is called structurally identifiable if it is possible to determine the values of its parameters from measurements of the model outputs. Structural identifiability is a prerequisite for parameter estimation, and should be assessed before exploiting a model. However, this analysis is seldom performed due to the high computational cost involved in the necessary symbolic calculations, which quickly becomes prohibitive as the problem size increases. In this paper we show how to analyse the structural identifiability of a very general class of nonlinear models by extending methods originally developed for studying observability. We present results about models whose identifiability had not been previously determined, report unidentifiabilities that had not been found before, and show how to modify those unidentifiable models to make them identifiable. This method helps prevent problems caused by lack of identifiability analysis, which can compromise the success of tasks such as experiment design, parameter estimation, and model-based optimization. The procedure is called STRIKE-GOLDD (STRuctural Identifiability taKen as Extended-Generalized Observability with Lie Derivatives and Decomposition), and it is implemented in a MATLAB toolbox which is available as open source software. The broad applicability of this approach facilitates the analysis of the increasingly complex models used in systems biology and other areas, AFV acknowledges funding from the Galician government (Xunta de Galiza, Consellería de Cultura, Educación e Ordenación Universitaria http://www.edu.xunta.es/portal/taxonomy/term/206) through the I2C postdoctoral program, fellowship ED481B2014/133-0. AB and AFV were partially supported by grant DPI2013-47100-C2-2-P from the Spanish Ministry of Economy and Competitiveness (MINECO). AFV acknowledges additional funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 686282 (CanPathPro). AP was partially supported through EPSRC projects EP/M002454/1 and EP/J012041/1., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Parameter identifiability analysis and visualization in large-scale kinetic models of biosystems

  • Gábor, Attila
  • Villaverde, A. F.
  • Banga, Julio R.
[Background] Kinetic models of biochemical systems usually consist of ordinary differential equations that have many unknown parameters. Some of these parameters are often practically unidentifiable, that is, their values cannot be uniquely determined from the available data. Possible causes are lack of influence on the measured outputs, interdependence among parameters, and poor data quality. Uncorrelated parameters can be seen as the key tuning knobs of a predictive model. Therefore, before attempting to perform parameter estimation (model calibration) it is important to characterize the subset(s) of identifiable parameters and their interplay. Once this is achieved, it is still necessary to perform parameter estimation, which poses additional challenges., [Methods] We present a methodology that (i) detects high-order relationships among parameters, and (ii) visualizes the results to facilitate further analysis. We use a collinearity index to quantify the correlation between parameters in a group in a computationally efficient way. Then we apply integer optimization to find the largest groups of uncorrelated parameters. We also use the collinearity index to identify small groups of highly correlated parameters. The results files can be visualized using Cytoscape, showing the identifiable and non-identifiable groups of parameters together with the model structure in the same graph., [Results] Our contributions alleviate the difficulties that appear at different stages of the identifiability analysis and parameter estimation process. We show how to combine global optimization and regularization techniques for calibrating medium and large scale biological models with moderate computation times. Then we evaluate the practical identifiability of the estimated parameters using the proposed methodology. The identifiability analysis techniques are implemented as a MATLAB toolbox called VisId, which is freely available as open source from GitHub ( https://github.com/gabora/visid )., [Conclusions] Our approach is geared towards scalability. It enables the practical identifiability analysis of dynamic models of large size, and accelerates their calibration. The visualization tool allows modellers to detect parts that are problematic and need refinement or reformulation, and provides experimentalists with information that can be helpful in the design of new experiments., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 686282 (“CANPATHPRO”), from the EU FP7 project "NICHE" (ITN Grant number 289384), and from the Spanish MINECO project "SYNBIOFACTORY" (grant number DPI2014-55276-C5-2-R)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

GenSSI 2.0: multi-experiment structural identifiability analysis of SBML models

  • Ligon, Thomas S.
  • Fröhlich, Fabian
  • Chis, O.
  • Banga, Julio R.
  • Balsa-Canto, Eva
  • Hasenauer, Jan
3 pages, 1 figure.-- This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited., Motivation Mathematical modeling using ordinary differential equations is used in systems biology to improve the understanding of dynamic biological processes. The parameters of ordinary differential equation models are usually estimated from experimental data. To analyze a priori the uniqueness of the solution of the estimation problem, structural identifiability analysis methods have been developed. Results We introduce GenSSI 2.0, an advancement of the software toolbox GenSSI (Generating Series for testing Structural Identifiability). GenSSI 2.0 is the first toolbox for structural identifiability analysis to implement Systems Biology Markup Language import, state/parameter transformations and multi-experiment structural identifiability analysis. In addition, GenSSI 2.0 supports a range of MATLAB versions and is computationally more efficient than its previous version, enabling the analysis of more complex models., This work was supported by the German Research Foundation (DFG) through the Graduate School of Quantitative Biosciences Munich and the European Union’s Horizon 2020 research and innovation programme [grant agreement no. 686282] (CanPathPro)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Observability and Structural Identifiability of Nonlinear Biological Systems

  • Villaverde, A. F.
12 pages, 2 figures.-- This is an open access article distributed under the Creative Commons Attribution License, Observability is a modelling property that describes the possibility of inferring the internal state of a system from observations of its output. A related property, structural identifiability, refers to the theoretical possibility of determining the parameter values from the output. In fact, structural identifiability becomes a particular case of observability if the parameters are considered as constant state variables. It is possible to simultaneously analyse the observability and structural identificability of a model using the conceptual tools of differential geometry. Many complex biological processes can be described by systems of nonlinear ordinary differential equations and can therefore be analysed with this approach. The purpose of this review article is threefold: (I) to serve as a tutorial on observability and structural identificability of nonlinear systems, using the differential geometry approach for their analysis; (II) to review recent advances in the field; and (III) to identify open problems and suggest new avenues for research in this area, The author was supported by the European Union’s Horizon 2020 Research and Innovation programme under Grant Agreement no. 686282 (“CANPATHPRO”) during the writing of this paper, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Benchmarking optimization methods for parameter estimation in large kinetic models

  • Villaverde, A. F.
  • Fröhlich, Fabian
  • Weindl, Daniel
  • Hasenauer, Jan
  • Banga, Julio R.
9 pages, 2 figures, 2 tables.-- This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License, [Motivation] Kinetic models contain unknown parameters that are estimated by optimizing the fit to experimental data. This task can be computationally challenging due to the presence of local optima and ill-conditioning. While a variety of optimization methods have been suggested to surmount these issues, it is difficult to choose the best one for a given problem a priori. A systematic comparison of parameter estimation methods for problems with tens to hundreds of optimization variables is currently missing, and smaller studies provided contradictory findings. [Results] We use a collection of benchmarks to evaluate the performance of two families of optimization methods: (i) multi-starts of deterministic local searches and (ii) stochastic global optimization metaheuristics; the latter may be combined with deterministic local searches, leading to hybrid methods. A fair comparison is ensured through a collaborative evaluation and a consideration of multiple performance metrics. We discuss possible evaluation criteria to assess the trade-off between computational efficiency and robustness. Our results show that, thanks to recent advances in the calculation of parametric sensitivities, a multi-start of gradient-based local methods is often a successful strategy, but a better performance can be obtained with a hybrid metaheuristic. The best performer combines a global scatter search metaheuristic with an interior point local method, provided with gradients estimated with adjoint-based sensitivities. We provide an implementation of this method to render it available to the scientific community, This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 686282 (‘CANPATHPRO’), from the Spanish MINECO/FEDER projects SYNBIOFACTORY (DPI2014-55276-C5-2-R) and SYNBIOCONTROL (DPI2017-82896-C2-2-R), and from the German Research Foundation (DFG) through the Graduate School of Quantitative Biosciences Munich (QBM; F.F.), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Input-Dependent Structural Identifiability of Nonlinear Systems

  • Villaverde, A. F.
  • Evans, Neil D.
  • Chappell, Michael J.
  • Banga, Julio R.
6 pages, 2 figures.-- Open access, A dynamic model is structurally identifiable if it is possible to infer its unknown parameters by observing its output. Structural identifiability depends on the system dynamics, output, and input, as well as on the specific values of initial conditions and parameters. Here we present a symbolic method that characterizes the input that a model requires to be structurally identifiable. It determines which derivatives must be non-zero in order to have a sufficiently exciting input. Our approach considers structural identifiability as a generalization of nonlinear observability and incorporates extended Lie derivatives. The methodology assesses structural identifiability for time-varying inputs and, additionally, it can be used to determine the input profile that is required to make the parameters structurally locally identifiable. Furthermore, it is sometimes possible to replace an experiment with time-varying input with multiple experiments with constant inputs. We implement the resulting method as a MATLAB toolbox named STRIKE-GOLDD2. This tool can assist in the design of new experiments for the purpose of parameter estimation, This work was supported in part by the European Union Framework Programme for Research and Innovation (Horizon 2020, CanPathPro) under Grant 686282, and in part by the Spanish Ministerio de Economía y Competitividad and the European Regional Development Fund (SYNBIOCONTROL) under Grant DPI2017-82896-C2-2-R, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Análisis de observabilidad e identificabilidad estructural de modelos no lineales: aplicación a la vía de señalización JAK/STAT, Structural Identifiability and Observability Analysis of a JAK/STAT Signalling Pathway Model

  • Villaverde, A. F.
  • Banga, Julio R.
8 pages, 1 figure.-- XL Jornadas de Automática: libro de actas, Ferrol, 4-6 de septiembre de 2019.-- Open access publication under the terms and conditions of the Creative Commons Attribution CC BY-NC-SA 4.0 license, [EN] Observability and structural identifiability are classic systemic properties that describe whether it is theoretically possible to determine the state and parameter vectors of a model from its output. Recently we developed a MATLAB tool, STRIKE-GOLDD, which adopts a symbolic approach for analysing observability and structural identifiability of nonlinear ODE models. While being a general purpose tool, the motivation behind the development of STRIKE-GOLDD was the study of biological models, for which these analyses can provide very valuable insight. This paper demonstrates the application of STRIKE-GOLDD to a dynamic model of the JAK/STAT signaling pathway, which plays an important role in processes such as immunity, cell division, cell death and tumour formation. Using this model of biomedical relevance as a case study, the present paper provides a tutorial on the use of the STRIKE-GOLDD methodology, highlighting its capabilities and limitations, [ES] La observabilidad e identificabilidad estructural son propiedades que se corresponden con la posibilidad teórica de determinar los vectores de estado y de parámetros de un modelo a partir de su salida. Recientemente hemos desarrollado una herramienta MATLAB, STRIKE-GOLDD, que analiza la observabilidad e identificabilidad estructural local de modelos no lineales de ecuaciones diferenciales ordinarias empleando una metodología simbólica. Si bien STRIKE-GOLDD es una metodología de propósito general, su desarrollo está motivado por el estudio de modelos biológicos, para los que estos análisis son de especial relevancia. En este trabajo se analiza la observabilidad e identificabilidad estructural de un modelo dinámico de la vía de señalización celular JAK/STAT. Este sistema de transducción de señales juega un papel importante en procesos de inmunidad, proliferación y división celular, apoptosis y oncogénesis. Usando este modelo de relevancia biomédica como caso de estudio, el presente trabajo proporciona un tutorial sobre el uso de STRIKEGOLDD, ilustrando sus capacidades y limitaciones, Este trabajo ha recibido financiacion del programa Horizonte 2020 de la Union Europea, a traves del proyecto 686282 (CanPathPro), y del proyecto del Ministerio de Ciencia, Innovacion y Universidades SYNBIOCONTROL (DPI2017-82896-C2-2-R), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A Comparison of Methods for Quantifying Prediction Uncertainty in Systems Biology

  • Villaverde, A. F.
  • Raimúndez, Elba
  • Hasenauer, Jan
  • Banga, Julio R.
7 pages, 4 figures, 2 tables, The parameters of dynamical models of biological processes always possess some degree of uncertainty. This parameter uncertainty translates into an uncertainty of model predictions. The trajectories of unmeasured state variables are examples of such predictions. Quantifying the uncertainty associated with a given prediction is an important problem for model developers and users. However, the nonlinearity and complexity of most dynamical models renders it nontrivial. Here, we evaluate three state-of-the-art approaches for prediction uncertainty quantification using two models of different sizes and computational complexities. We discuss the trade-offs between applicability and statistical interpretability of the different methods, and provide guidelines for their application, This research has received funding from the European Unions Horizon 2020 research and innovation program under grant agreement No 686282 (CanPathPro) and the German Ministry of Education and Research (BMBF) under the grant agreement No 01ZX1310B (SYS-Stomach) and No 01ZX1705A (INCOME), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

PEtab—Interoperable specification of parameter estimation problems in systems biology

  • Schmiester, Leonard
  • Schälte, Yannik
  • Bergmann, Frank T.
  • Camba, Tacio
  • Dudkin, Erika
  • Egert, Janine
  • Frölich, Fabian
  • Fuhrmann, Lara
  • Hauber, Adrian L.
  • Kemmer, Svenja
  • Lakrisenko, Polina
  • Loos, Carolin
  • Merkt, Simon
  • Müller, Wolfgang
  • Pathirana, Dilan
  • Raimúndez, Elba
  • Refisch, Lukas
  • Rosenblatt, Marcus
  • Stapor, Paul L.
  • Städter, Philipp
  • Wang, Dantong
  • Wieland, Franz-Georg
  • Banga, Julio R.
  • Timmer, Jens
  • Villaverde, A. F.
  • Sahle, Sven
  • Kreutz, Clemens
  • Hasenauer, Jan
  • Weindl, Daniel
10 pages, 3 figures, 2 tables.-- This is an open access article distributed under the terms of the Creative Commons Attribution License, Reproducibility and reusability of the results of data-based modeling studies are essential. Yet, there has been—so far—no broadly supported format for the specification of parameter estimation problems in systems biology. Here, we introduce PEtab, a format which facilitates the specification of parameter estimation problems using Systems Biology Markup Language (SBML) models and a set of tab-separated value files describing the observation model and experimental data as well as parameters to be estimated. We already implemented PEtab support into eight well-established model simulation and parameter estimation toolboxes with hundreds of users in total. We provide a Python library for validation and modification of a PEtab problem and currently 20 example parameter estimation problems based on recent studies, This work was supported by the European Union’s Horizon 2020 research and innovation program (CanPathPro; Grant no. 686282; J.H., D.W., P.L.S., E.D., S.M., A.F.V., J.R.B.), the German Federal Ministry of Education and Research (Grant no. 01ZX1916A; D.W., P.L. & 01ZX1705A; J.H., P.L. & Grant. no. 031L0159C; J.H. & de.NBI ModSim1, 031L0104A; F.T.B. & EA:Sys, 031L0080; J.E, L.R & Grant no. 031L0048; S.K., F.G.W. & 01ZX1310B; E.R.), the German Federal Ministry of Economic Affairs and Energy (Grant no. 16KN074236; D.P.), the German Research Foundation (Grant no. HA7376/1-1; Y.S.; CIBSS-EXC-2189-2100249960-390939984; C.K., J.T.; project ID: 272983813 - TRR 179; M.R. & Clusters of Excellence EXC 2047 and EXC 2151; E.R., J.H.), the Deutsche Krebshilfe (Grant no. 70112355; A.L.H.), the Human Frontier Science Program (Grant no. LT000259/2019-L1; F.F.), the National Institute of Health (Grant no. U54-CA225088; F.F.), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A protocol for dynamic model calibration

  • Villaverde, A. F.
  • Pathirana, Dilan
  • Fröhlich, Fabian
  • Hasenauer, Jan
  • Banga, Julio R.
19 pages, 6 figures, 2 tables.-- This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License, Ordinary differential equation models are nowadays widely used for the mechanistic description of biological processes and their temporal evolution. These models typically have many unknown and nonmeasurable parameters, which have to be determined by fitting the model to experimental data. In order to perform this task, known as parameter estimation or model calibration, the modeller faces challenges such as poor parameter identifiability, lack of sufficiently informative experimental data and the existence of local minima in the objective function landscape. These issues tend to worsen with larger model sizes, increasing the computational complexity and the number of unknown parameters. An incorrectly calibrated model is problematic because it may result in inaccurate predictions and misleading conclusions. For nonexpert users, there are a large number of potential pitfalls. Here, we provide a protocol that guides the user through all the steps involved in the calibration of dynamic models. We illustrate the methodology with two models and provide all the code required to reproduce the results and perform the same analysis on new models. Our protocol provides practitioners and researchers in biological modelling with a one-stop guide that is at the same time compact and sufficiently comprehensive to cover all aspects of the problem, European Union’s Horizon 2020 Research and Innovation Programme (grant no. 686282) (‘CANPATHPRO’); Spanish MINECO/FEDER Project SYNBIOCONTROL (DPI2017-82896-C2-2-R to J.R.B.); Ramón y Cajal Fellowship (RYC-2019-027537-I to A.F.V.) from the Ministerio de Ciencia e innovación, Spain; Consellería de Cultura, Educación e Ordenación Universitaria, Xunta de Galicia (ED431F 2021/003 to A.F.V.); Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany’s Excellence Strategy (EXC 2151 - 390873048 to J.H.), (EXC-2047/1 - 390685813 to D.P.); German Federal Ministry of Economic Affairs and Energy (grant no. 16KN074236 to D.P.). Ministerio de Ciencia e Innovación, Spain (grant PID2020-117271RB-C22, ‘BIODYNAMICS’, to J.R.B.; Funding for open access charge: Universidade de Vigo/CISUG), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Assessment of Prediction Uncertainty Quantification Methods in Systems Biology

  • Villaverde, Alejandro F
  • Raimúndez, Elba
  • Hasenauer, Jan
  • Banga, Julio R.
Biological processes are often modelled using ordinary differential equations. The unknown parameters of these models are estimated by optimizing the fit of model simulation and experimental data. The resulting parameter estimates inevitably possess some degree of uncertainty. In practical applications it is important to quantify these parameter uncertainties as well as the resulting prediction uncertainty, which are uncertainties of potentially time-dependent model characteristics. Unfortunately, estimating prediction uncertainties accurately is nontrivial, due to the nonlinear dependence of model characteristics on parameters. While a number of numerical approaches have been proposed for this task, their strengths and weaknesses have not been systematically assessed yet. To fill this knowledge gap, we apply four state of the art methods for uncertainty quantification to four case studies of different computational complexities. This reveals the trade-offs between their applicability and their statistical interpretability. Our results provide guidelines for choosing the most appropriate technique for a given problem and applying it successfully., This research has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 686282 (CanPathPro). ER and JH acknowledge funding from the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) - TRR333/1 - 450149205 and under Germany’s Excellence Strategy EXC-2047/1 - 390685813 and EXC 2151 - 390873048.AFV acknowledges funding from grant ED431F 2021/003 Universitaria, Xunta de Galicia; and from grant RYC-2019- 027537-I funded by MCIN/AEI/ 10.13039/501100011033 and by “ESF Investing in your future”. JRB acknowledges funding from MCIN/AEI/ 10.13039/501100011033 through grant PID2020-117271RB-C22 (BIODYNAMICS), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Strike-goldd_2.1 2.1.2

  • Villaverde, A. F.
1 zip file, A MATLAB toolbox for structural identifiability and observability analysis of nonlinear models, STRIKE-GOLDD has received funding from the Galician government (Xunta de Galiza) through the I2C postdoctoral program, fellowship ED481B2014/133-0, from the Spanish Ministry of Economy and Competitiveness (MINECO), grant DPI2013-47100-C2-2-P, from the EPSRC projects EP/M002454/1 and EP/J012041/1, and from the European Union's Horizon 2020 research and innovation programme under grant agreement No 686282 ("CANPATHPRO"), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

strike-goldd_2.1: First release of STRIKE-GOLDD 2.1

  • Villaverde, A. F.
1 file, This is the first release of the 2.1 version, European Commission, CanPathPro - Generation of the CanPath prototype - a platform for predictive cancer pathway modeling 686282, Peer reviewed