Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Metastable dynamics emerge from local excitatory–inhibitory homeostasis in the cortex at rest

  • Verschure, Paul F. M. J.
  • Páscoa dos Santos, Francisco
The dynamics of the human cortex are highly metastable, driving the spontaneous exploration of network states. This metastability depends on circuit-level edge-of-bifurcation dynamics, which emerge from firing-rate control through multiple mechanisms of excitatory–inhibitory (E–I) homeostasis. However, it is unclear how these contribute to the metastability of cortical networks. We propose that individual mechanisms of the E–I homeostasis contribute uniquely to the emergence of resting-state dynamics and test this hypothesis in a large-scale model of the human cortex. We show that empirical connectivity and dynamics can only be reproduced when accounting for multiple mechanisms of the E–I homeostasis. More specifically, while the homeostasis of excitation and inhibition enhances metastability, the regulation of intrinsic excitability ensures moderate synchrony, maximizing functional complexity. Furthermore, the modulation bifurcation modulation by the homeostasis of excitation and intrinsic excitability compensates for strong input fluctuations in connector hubs. Importantly, this only occurs in models accounting for local gamma oscillations, suggesting a relationship between E–I balance, gamma rhythms, and metastable dynamics. Altogether, our results show that cortical networks self-organize toward maximal metastability through the multifactor homeostasis of E–I balance. Therefore, the benefits of combining multiple homeostatic mechanisms transcend the circuit level, supporting the metastable dynamics of large-scale cortical networks.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Advancing the science of consciousness: from ethics to clinical care

  • Farisco, Michele
  • Evers, Kathinka
  • Annen, Jitka
  • Blandin, Veronique
  • Camassa, Alessandra
  • Cecconi, Benedetta
  • Charland, Vanessa
  • Deco, Gustavo
  • Gosseries, Olivia
  • Laureys, Steven
  • Manasanch, Arnau
  • Massimini, Marcello
  • Muckli, Lars F.
  • Panda, Rajanikant
  • Pennartz, Cyriel
  • Pigorini, Andrea
  • Torao-Angosto, Melody
  • Sanchez-Vives, Maria V.
  • Goldman, Jennifer
  • Zamora-López, Gorka
Significant advances in the scientific investigation of the neurobiology of consciousness have been slow to be translated into clinical settings, limited by a lack of generally agreed working definition (e.g., what is consciousness?) and methodology (e.g., how to identify reliable biomarkers/indicators of consciousness? How to improve sensitivity and specificity of the technological identification of consciousness?). In the present paper we aim at proposing potential strategies for reducing the gap between research, clinical practice, and patients' and their caregivers' needs regarding disorders of consciousness. By implementing a multidisciplinary (i.e., involving different disciplines) and multiperspective (i.e., involving different stakeholders) approach, the paper focuses on disorders of consciousness: it starts from the review of some of the most promising measures of consciousness from brain activity (i.e., electrophysiology and spectral measures, measures of functional connectivity, complexity-based measures). Next the paper introduces brain responses to illusions as a possible new indicator of consciousness (i.e., a feature that facilitates the attribution of consciousness), and illustrates a possible clinical operationalization of the indicators of consciousness through the case of virtual reality. Finally, the paper analyses a set of urgent ethical issues and describes a model for assessing and dealing with those issues, concluding by elaborating key recommendations for improving the clinical treatment of patients with disorders of consciousness through a better translation of research into clinics., The research is supported by funding from the European Union's Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 945539 (Human Brain Project SGA3). JA is postdoctoral fellow funded (1265522N) by the Fund for Scientific Research-Flanders (FWO). BC is doctoral candidate at the GIGA Doctoral School for Health Science (University of Liege) and FNRS-ASP. OG is Research Associate at FRS-FNRS. CP and SL are Research Directors at FRS-FNRS. GZL was supported by ERDF-Project Brain dynamics, No. CZ.02.01.01/00/22_008/0004643. MF and KE were supported by the project Counterfactual Assessment and Valuation for Awareness Architecture-CAVAA (European Commission, EIC 101071178).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Modeling theory of mind in dyadic games using adaptive feedback control

  • Freire, Ismael T.
  • Arsiwalla, Xerxes D.
  • Puigbò Llobet, Jordi-Ysard
  • Verschure, Paul F. M. J.
A major challenge in cognitive science and AI has been to understand how intelligent autonomous agents might acquire and predict the behavioral and mental states of other agents in the course of complex social interactions. How does such an agent model the goals, beliefs, and actions of other agents it interacts with? What are the computational principles to model a Theory of Mind (ToM)? Deep learning approaches to address these questions fall short of a better understanding of the problem. In part, this is due to the black-box nature of deep networks, wherein computational mechanisms of ToM are not readily revealed. Here, we consider alternative hypotheses seeking to model how the brain might realize a ToM. In particular, we propose embodied and situated agent models based on distributed adaptive control theory to predict the actions of other agents in five different game-theoretic tasks (Harmony Game, Hawk-Dove, Stag Hunt, Prisoner’s Dilemma, and Battle of the Exes). Our multi-layer control models implement top-down predictions from adaptive to reactive layers of control and bottom-up error feedback from reactive to adaptive layers. We test cooperative and competitive strategies among seven different agent models (cooperative, greedy, tit-for-tat, reinforcement-based, rational, predictive, and internal agents). We show that, compared to pure reinforcement-based strategies, probabilistic learning agents modeled on rational, predictive, and internal phenotypes perform better in game-theoretic metrics across tasks. The outlined autonomous multi-agent models might capture systems-level processes underlying a ToM and suggest architectural principles of ToM from a control-theoretic perspective., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement ID:820742, and from the European Union’s Horizon EIC Grants 2021 under grant agreement ID:101071178.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Theta oscillations optimize a speed-precision trade-off in phase coding neurons

  • Amil, Adrián F.
  • Albesa-González, Albert
  • Verschure, Paul
Theta-band oscillations (3-8 Hz) in the mammalian hippocampus organize the temporal structure of cortical inputs, resulting in a phase code that enables rhythmic input sampling for episodic memory formation and spatial navigation. However, it remains unclear what evolutionary pressures might have driven the selection of theta over higher-frequency bands that could potentially provide increased input sampling resolution. Here, we address this question by introducing a theoretical framework that combines the efficient coding and neural oscillatory sampling hypotheses, focusing on the information rate (bits/s) of phase coding neurons. We demonstrate that physiologically realistic noise levels create a trade-off between the speed of input sampling, determined by oscillation frequency, and encoding precision in rodent hippocampal neurons. This speed-precision trade-off results in a maximum information rate of ∼1-2 bits/s within the theta frequency band, thus confining the optimal oscillation frequency to the low end of the spectrum. We also show that this framework accounts for key hippocampal features, such as the preservation of the theta band along the dorsoventral axis despite physiological gradients, and the modulation of theta frequency and amplitude by running speed. Extending the analysis beyond the hippocampus, we propose that theta oscillations could also support efficient stimulus encoding in the visual cortex and olfactory bulb. More broadly, our framework lays the foundation for studying how system features, such as noise, constrain the optimal sampling frequencies in both biological and artificial brains., This work was supported by a HORIZON-EIC-2021 Pathfinder Challenges grant to CAVAA, project number 101071178 (to P.F.M.J.V.). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Preliminaries to artificial consciousness: a multidimensional heuristic approach

  • Evers, K.
  • Farisco, M.
  • Chatila, R.
  • Earp, B. D.
  • Freire, I. T.
  • Hamker, F.
  • Nemeth, E.
  • Verschure, Paul
  • Khamassi, M.
The pursuit of artificial consciousness requires conceptual clarity to navigate its theoretical and empirical challenges. This paper introduces a composite, multilevel, and multidimensional model of consciousness as a heuristic framework to guide research in this field. Consciousness is treated as a complex phenomenon, with distinct constituents and dimensions that can be operationalized for study and for evaluating their replication. We argue that this model provides a balanced approach to artificial consciousness research by avoiding binary thinking (e.g., conscious vs. non-conscious) and offering a structured basis for testable hypotheses. To illustrate its utility, we focus on "awareness" as a case study, demonstrating how specific dimensions of consciousness can be pragmatically analyzed and targeted for potential artificial instantiation. By breaking down the conceptual intricacies of consciousness and aligning them with practical research goals, this paper lays the groundwork for a robust strategy to advance the scientific and technical understanding of artificial consciousness., This research has received funding from the project Counterfactual Assessment and Valuation for Awareness Architecture–CAVAA (European Commission, EIC 101071178). We thank two anonymous reviewers for their comments which helped us to improve both the readability and the clarity of the text., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Sequential memory improves sample and memory efficiency in episodic control

  • Freire, I. T.
  • Amil, Adrián F.
  • Verschure, Paul
Deep reinforcement learning algorithms are known for their sample inefficiency, requiring extensive episodes to reach optimal performance. Episodic reinforcement learning algorithms aim to overcome this issue by using extended memory systems to leverage past experiences. However, these memory augmentations are often used as mere buffers, from which isolated events are resampled for offline learning (for example, replay). In this Article, we introduce Sequential Episodic Control (SEC), a hippocampal-inspired model that stores entire event sequences in their temporal order and employs a sequential bias in their retrieval to guide actions. We evaluate SEC across various benchmarks from the Animal-AI testbed, demonstrating its superior performance and sample efficiency compared to several state-of-the-art models, including Model-Free Episodic Control, Deep Q-Network and Episodic Reinforcement Learning with Associative Memory. Our experiments show that SEC achieves higher rewards and faster policy convergence in tasks requiring memory and decision-making. Additionally, we investigate the effects of memory constraints and forgetting mechanisms, revealing that prioritized forgetting enhances both performance and policy stability. Further, ablation studies demonstrate the critical role of the sequential memory component in SEC. Finally, we discuss how fast, sequential hippocampal-like episodic memory systems could support both habit formation and deliberation in artificial and biological systems., This study was funded by the Counterfactual Assessment and Valuation for Awareness Architecture (CAVAA) project (European Innovation Council’s Horizon programme, grant no. 101071178) awarded to P.F.M.J.V., Peer reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Metastable dynamics emerge from local excitatory–inhibitory homeostasis in the cortex at rest

  • Verschure, Paul F. M. J.
  • Páscoa dos Santos, Francisco
The dynamics of the human cortex are highly metastable, driving the spontaneous exploration of network states. This metastability depends on circuit-level edge-of-bifurcation dynamics, which emerge from firing-rate control through multiple mechanisms of excitatory–inhibitory (E–I) homeostasis. However, it is unclear how these contribute to the metastability of cortical networks. We propose that individual mechanisms of the E–I homeostasis contribute uniquely to the emergence of resting-state dynamics and test this hypothesis in a large-scale model of the human cortex. We show that empirical connectivity and dynamics can only be reproduced when accounting for multiple mechanisms of the E–I homeostasis. More specifically, while the homeostasis of excitation and inhibition enhances metastability, the regulation of intrinsic excitability ensures moderate synchrony, maximizing functional complexity. Furthermore, the modulation bifurcation modulation by the homeostasis of excitation and intrinsic excitability compensates for strong input fluctuations in connector hubs. Importantly, this only occurs in models accounting for local gamma oscillations, suggesting a relationship between E–I balance, gamma rhythms, and metastable dynamics. Altogether, our results show that cortical networks self-organize toward maximal metastability through the multifactor homeostasis of E–I balance. Therefore, the benefits of combining multiple homeostatic mechanisms transcend the circuit level, supporting the metastable dynamics of large-scale cortical networks.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Advancing the science of consciousness: from ethics to clinical care

  • Farisco, Michele
  • Evers, Kathinka
  • Annen, Jitka
  • Blandin, Veronique
  • Camassa, Alessandra
  • Cecconi, Benedetta
  • Charland, Vanessa
  • Deco, Gustavo
  • Gosseries, Olivia
  • Laureys, Steven
  • Manasanch, Arnau
  • Massimini, Marcello
  • Muckli, Lars F.
  • Panda, Rajanikant
  • Pennartz, Cyriel
  • Pigorini, Andrea
  • Torao-Angosto, Melody
  • Sanchez-Vives, Maria V.
  • Goldman, Jennifer
  • Zamora-López, Gorka
Significant advances in the scientific investigation of the neurobiology of consciousness have been slow to be translated into clinical settings, limited by a lack of generally agreed working definition (e.g., what is consciousness?) and methodology (e.g., how to identify reliable biomarkers/indicators of consciousness? How to improve sensitivity and specificity of the technological identification of consciousness?). In the present paper we aim at proposing potential strategies for reducing the gap between research, clinical practice, and patients' and their caregivers' needs regarding disorders of consciousness. By implementing a multidisciplinary (i.e., involving different disciplines) and multiperspective (i.e., involving different stakeholders) approach, the paper focuses on disorders of consciousness: it starts from the review of some of the most promising measures of consciousness from brain activity (i.e., electrophysiology and spectral measures, measures of functional connectivity, complexity-based measures). Next the paper introduces brain responses to illusions as a possible new indicator of consciousness (i.e., a feature that facilitates the attribution of consciousness), and illustrates a possible clinical operationalization of the indicators of consciousness through the case of virtual reality. Finally, the paper analyses a set of urgent ethical issues and describes a model for assessing and dealing with those issues, concluding by elaborating key recommendations for improving the clinical treatment of patients with disorders of consciousness through a better translation of research into clinics., The research is supported by funding from the European Union's Horizon 2020 Framework Programme for Research and Innovation under the Specific Grant Agreement No. 945539 (Human Brain Project SGA3). JA is postdoctoral fellow funded (1265522N) by the Fund for Scientific Research-Flanders (FWO). BC is doctoral candidate at the GIGA Doctoral School for Health Science (University of Liege) and FNRS-ASP. OG is Research Associate at FRS-FNRS. CP and SL are Research Directors at FRS-FNRS. GZL was supported by ERDF-Project Brain dynamics, No. CZ.02.01.01/00/22_008/0004643. MF and KE were supported by the project Counterfactual Assessment and Valuation for Awareness Architecture-CAVAA (European Commission, EIC 101071178).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Modeling theory of mind in dyadic games using adaptive feedback control

  • Freire, Ismael T.
  • Arsiwalla, Xerxes D.
  • Puigbò Llobet, Jordi-Ysard
  • Verschure, Paul F. M. J.
A major challenge in cognitive science and AI has been to understand how intelligent autonomous agents might acquire and predict the behavioral and mental states of other agents in the course of complex social interactions. How does such an agent model the goals, beliefs, and actions of other agents it interacts with? What are the computational principles to model a Theory of Mind (ToM)? Deep learning approaches to address these questions fall short of a better understanding of the problem. In part, this is due to the black-box nature of deep networks, wherein computational mechanisms of ToM are not readily revealed. Here, we consider alternative hypotheses seeking to model how the brain might realize a ToM. In particular, we propose embodied and situated agent models based on distributed adaptive control theory to predict the actions of other agents in five different game-theoretic tasks (Harmony Game, Hawk-Dove, Stag Hunt, Prisoner’s Dilemma, and Battle of the Exes). Our multi-layer control models implement top-down predictions from adaptive to reactive layers of control and bottom-up error feedback from reactive to adaptive layers. We test cooperative and competitive strategies among seven different agent models (cooperative, greedy, tit-for-tat, reinforcement-based, rational, predictive, and internal agents). We show that, compared to pure reinforcement-based strategies, probabilistic learning agents modeled on rational, predictive, and internal phenotypes perform better in game-theoretic metrics across tasks. The outlined autonomous multi-agent models might capture systems-level processes underlying a ToM and suggest architectural principles of ToM from a control-theoretic perspective., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement ID:820742, and from the European Union’s Horizon EIC Grants 2021 under grant agreement ID:101071178.