Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The why, what, where, when and how of goal-directed choice: neuronal and computational principles

  • Verschure, Paul F. M. J.
  • Pennartz, Cyriel
  • Pezzulo, Giovanni
The central problems that goal-directed animals must solve are: ‘What do I need and Why, Where and When can this be obtained, and How do I get it?' or the H4W problem. Here, we elucidate the principles underlying the neuronal solutions to H4W using a combination of neurobiological and neurorobotic approaches. First, we analyse H4W from a system-level perspective by mapping its objectives onto the Distributed Adaptive Control embodied cognitive architecture which sees the generation of adaptive action in the real world as the primary task of the brain rather than optimally solving abstract problems. We next map this functional decomposition to the architecture of the rodent brain to test its consistency. Following this approach, we propose that the mammalian brain solves the H4W problem on the basis of multiple kinds of outcome predictions, integrating central representations of needs and drives (e.g. hypothalamus), valence (e.g. amygdala), world, self and task state spaces (e.g. neocortex, hippocampus and prefrontal cortex, respectively) combined with multi-modal selection (e.g. basal ganglia). In our analysis, goal-directed behaviour results from a well-structured architecture in which goals are bootstrapped on the basis of predefined needs, valence and multiple learning, memory and planning mechanisms rather than being generated by a singular computation., Research funded by the EU FP7 framework under grant agreements no. FP7-ICT-270108 (Goal-Leaders), FP7-ICT-270490 (EFAA), FP7-ICT-612139 (WYSIWYD), ERC-341196 (CDAC) and FP7-ICT-601167 (CSN II).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

How? Why? What? Where? When? Who? Grounding ontology in the actions of a situated social agent

  • Lallée, Stéphane
  • Verschure, Paul F. M. J.
Robotic agents are spreading, incarnated as embodied entities, exploring the tangible world and interacting with us, or as virtual agents crawling over the web, parsing and generating data. In both cases, they require: (i) processes to acquire information; (ii) structures to model and store information as usable knowledge; (iii) reasoning systems to interpret the information; and (iv) finally, ways to express their interpretations. The H5W (How, Why, What, Where, When, Who) framework is a conceptualization of the problems faced by any agent situated in a social environment, which has defined several robotic studies. We introduce the H5W framework, through a description of its underlying neuroscience and the psychological considerations it embodies, we then demonstrate a specific implementation of the framework. We will focus on the motivation and implication of the pragmatic decisions we have taken. We report the numerous studies that have relied upon this technical implementation as a proof of its robustness and polyvalence; moreover, we conduct an additional validation of its applicability to the natural language domain by designing an information exchange task as a benchmark., This work is supported by the EU FP7 project WYSIWYD (FP7-ICT-612139) and by A*STAR JCO grant #1335H00098. We would like to thank Luke Boorman for his contribution to the final version of this manuscript.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

iCub-HRI: a software framework for complex human-robot interaction scenarios on the iCub humanoid robot

  • Fischer, Tobias
  • Puigbò Llobet, Jordi-Ysard
  • Camilleri, Daniel
  • Nguyen, Phuong D.H.
  • Moulin-Frier, Clément
  • Lallée, Stéphane
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Verschure, Paul F. M. J.
Generating complex, human-like behavior in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, and touch detection), object manipulation (basic and complex motor actions), and social interaction (speech synthesis and joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human–robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behavior and expression of a verbal narrative of the robot’s experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarizing themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community., The research leading to these results has received funding under the European Union’s Seventh Framework Programme (FP/2007-2013)/ERC Grant Agreement n. FP7-ICT-612139 (WYSIWYD—What You Say Is What You Did) and FP7-ICT-270490 (EFAA—The Experimental Functional Android Assistant). PN was supported by a Marie Curie Early Stage Researcher Fellowship (H2020-MSCA-ITA, SECURE 642667). PV was supported by the ERC advanced grant 341196 (cDAC—Role of Consciousness in Adaptive Behavior).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

DAC-h3: a proactive robot cognitive architecture to acquire and express knowledge about the world and the self

  • Moulin-Frier, Clément
  • Fischer, Tobias
  • Petit, Maxime
  • Pointeau, Grégoire
  • Puigbò Llobet, Jordi-Ysard
  • Pattacini, Ugo
  • Ching Low, Sock
  • Camilleri, Daniel
  • Nguyen, Phuong
  • Hoffmann, Matej
  • Jin Chang, Hyung
  • Zambelli, Martina
  • Mealier, Anne-Laure
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Ford Dominey, Peter
  • Verschure, Paul F. M. J.
This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both human and robot. The framework, based on a biologically grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users., This work was supported in part by the European Research Council through the European Union’s Seventh Framework Programme (FP/2007–2013), in part by the ERC through the What You Say Is What You Did project under Grant FP7-ICT-612139, and in part by the ERC’s CDAC Project—Role of Consciousness in Adaptive Behavior under Grant ERC-2013-ADG 341196. The work of D. Camilleri and T. Prescott was supported by the EU Seventh Framework Programme as part of the Human Brain (HBP-SGA1) under Project 720270. The work of P. Nguyen was supported by the ERC’s H2020 under Grant 642667 (SECURE). The work of M. Hoffmann was supported by the Czech Science Foundation under Project GA17-15697Y.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The impact of cortical lesions on thalamo-cortical network dynamics after acute ischaemic stroke: a combined experimental and theoretical study

  • Van Wijngaarden, Joeri B. G.
  • Zucca, Riccardo
  • Finnigan, Simon
  • Verschure, Paul F. M. J.
The neocortex and thalamus provide a core substrate for perception, cognition, and action, and are interconnected through different direct and indirect pathways that maintain specific dynamics associated with functional states including wakefulness and sleep. It has been shown that a lack of excitation, or enhanced subcortical inhibition, can disrupt this system and drive thalamic nuclei into an attractor state of low-frequency bursting and further entrainment of thalamo-cortical circuits, also called thalamo-cortical dysrhythmia (TCD). The question remains however whether similar TCD-like phenomena can arise with a cortical origin. For instance, in stroke, a cortical lesion could disrupt thalamo-cortical interactions through an attenuation of the excitatory drive onto the thalamus, creating an imbalance between excitation and inhibition that can lead to a state of TCD. Here we tested this hypothesis by comparing the resting-state EEG recordings of acute ischaemic stroke patients (N = 21) with those of healthy, age-matched control-subjects (N = 17). We observed that these patients displayed the hallmarks of TCD: a characteristic downward shift of dominant α-peaks in the EEG power spectra, together with increased power over the lower frequencies (δ and θ-range). Contrary to general observations in TCD, the patients also displayed a broad reduction in β-band activity. In order to explain the genesis of this stroke-induced TCD, we developed a biologically constrained model of a general thalamocortical module, allowing us to identify the specific cellular and network mechanisms involved. Our model showed that a lesion in the cortical component leads to sustained cell membrane hyperpolarization in the corresponding thalamic relay neurons, that in turn leads to the de-inactivation of voltage-gated T-type Ca2+-channels, switching neurons from tonic spiking to a pathological bursting regime. This thalamic bursting synchronises activity on a population level through divergent intrathalamic circuits, and entrains thalamo-cortical pathways by means of propagating low-frequency oscillations beyond the restricted region of the lesion. Hence, pathological stroke-induced thalamo-cortical dynamics can be the source of diaschisis, and account for the dissociation between lesion location and non-specific symptoms of stroke such as neuropathic pain and hemispatial neglect., This work was supported by the European Research Council under the European Union's Seventh Framework Programme FP7/2007-2013/ERC grant agreement n. 341196 [CDAC], and the Research and Technological Development Programme FP7-ICT-612139 in the WYSIWYD project to PFMJV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Metrics for probabilistic geometries

  • Tosi, Alessandra
  • Hauberg, Søren
  • Vellido Alcacena, Alfredo|||0000-0002-9843-1911
  • Lawrence, Neil D.
We investigate the geometrical structure of probabilistic generative dimensionality reduction models using the tools of Riemannian geometry. We explicitly define a distribution over the natural metric given by the models. We provide the necessary algorithms to compute expected metric tensors where the distribution over mappings is given by a Gaussian process. We treat the corresponding latent variable model as a Riemannian manifold and we use the expectation of the metric under the Gaussian process prior to define interpolating paths and measure distance between latent points. We show how distances that respect the expected metric lead to more appropriate generation of new data., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

DAC-h3: a proactive robot cognitive architecture to acquire and express knowledge about the world and the self

  • Moulin-Frier, Clément
  • Fischer, Tobias
  • Petit, Maxime
  • Pointeau, Grégoire
  • Puigbò Llobet, Jordi-Ysard
  • Pattacini, Ugo
  • Ching Low, Sock
  • Camilleri, Daniel
  • Nguyen, Phuong
  • Hoffmann, Matej
  • Jin Chang, Hyung
  • Zambelli, Martina
  • Mealier, Anne-Laure
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Ford Dominey, Peter
  • Verschure, Paul F. M. J.
This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both human and robot. The framework, based on a biologically grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users., This work was supported in part by the European Research Council through the European Union’s Seventh Framework Programme (FP/2007–2013), in part by the ERC through the What You Say Is What You Did project under Grant FP7-ICT-612139, and in part by the ERC’s CDAC Project—Role of Consciousness in Adaptive Behavior under Grant ERC-2013-ADG 341196. The work of D. Camilleri and T. Prescott was supported by the EU Seventh Framework Programme as part of the Human Brain (HBP-SGA1) under Project 720270. The work of P. Nguyen was supported by the ERC’s H2020 under Grant 642667 (SECURE). The work of M. Hoffmann was supported by the Czech Science Foundation under Project GA17-15697Y.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The why, what, where, when and how of goal-directed choice: neuronal and computational principles

  • Verschure, Paul F. M. J.
  • Pennartz, Cyriel
  • Pezzulo, Giovanni
The central problems that goal-directed animals must solve are: ‘What do I need and Why, Where and When can this be obtained, and How do I get it?' or the H4W problem. Here, we elucidate the principles underlying the neuronal solutions to H4W using a combination of neurobiological and neurorobotic approaches. First, we analyse H4W from a system-level perspective by mapping its objectives onto the Distributed Adaptive Control embodied cognitive architecture which sees the generation of adaptive action in the real world as the primary task of the brain rather than optimally solving abstract problems. We next map this functional decomposition to the architecture of the rodent brain to test its consistency. Following this approach, we propose that the mammalian brain solves the H4W problem on the basis of multiple kinds of outcome predictions, integrating central representations of needs and drives (e.g. hypothalamus), valence (e.g. amygdala), world, self and task state spaces (e.g. neocortex, hippocampus and prefrontal cortex, respectively) combined with multi-modal selection (e.g. basal ganglia). In our analysis, goal-directed behaviour results from a well-structured architecture in which goals are bootstrapped on the basis of predefined needs, valence and multiple learning, memory and planning mechanisms rather than being generated by a singular computation., Research funded by the EU FP7 framework under grant agreements no. FP7-ICT-270108 (Goal-Leaders), FP7-ICT-270490 (EFAA), FP7-ICT-612139 (WYSIWYD), ERC-341196 (CDAC) and FP7-ICT-601167 (CSN II).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

iCub-HRI: a software framework for complex human-robot interaction scenarios on the iCub humanoid robot

  • Fischer, Tobias
  • Puigbò Llobet, Jordi-Ysard
  • Camilleri, Daniel
  • Nguyen, Phuong D.H.
  • Moulin-Frier, Clément
  • Lallée, Stéphane
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Verschure, Paul F. M. J.
Generating complex, human-like behavior in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, and touch detection), object manipulation (basic and complex motor actions), and social interaction (speech synthesis and joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human–robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behavior and expression of a verbal narrative of the robot’s experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarizing themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community., The research leading to these results has received funding under the European Union’s Seventh Framework Programme (FP/2007-2013)/ERC Grant Agreement n. FP7-ICT-612139 (WYSIWYD—What You Say Is What You Did) and FP7-ICT-270490 (EFAA—The Experimental Functional Android Assistant). PN was supported by a Marie Curie Early Stage Researcher Fellowship (H2020-MSCA-ITA, SECURE 642667). PV was supported by the ERC advanced grant 341196 (cDAC—Role of Consciousness in Adaptive Behavior).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Metrics for probabilistic geometries

  • Tosi, Alessandra
  • Hauberg, Søren
  • Vellido Alcacena, Alfredo
  • Lawrence, Neil D.
We investigate the geometrical structure of probabilistic generative dimensionality reduction models using the tools of Riemannian geometry. We explicitly define a distribution over the natural metric given by the models. We provide the necessary algorithms to compute expected metric tensors where the distribution over mappings is given by a Gaussian process. We treat the corresponding latent variable model as a Riemannian manifold and we use the expectation of the metric under the Gaussian process prior to define interpolating paths and measure distance between latent points. We show how distances that respect the expected metric lead to more appropriate generation of new data., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

How? Why? What? Where? When? Who? Grounding ontology in the actions of a situated social agent

  • Lallée, Stéphane
  • Verschure, Paul F. M. J.
Robotic agents are spreading, incarnated as embodied entities, exploring the tangible world and interacting with us, or as virtual agents crawling over the web, parsing and generating data. In both cases, they require: (i) processes to acquire information; (ii) structures to model and store information as usable knowledge; (iii) reasoning systems to interpret the information; and (iv) finally, ways to express their interpretations. The H5W (How, Why, What, Where, When, Who) framework is a conceptualization of the problems faced by any agent situated in a social environment, which has defined several robotic studies. We introduce the H5W framework, through a description of its underlying neuroscience and the psychological considerations it embodies, we then demonstrate a specific implementation of the framework. We will focus on the motivation and implication of the pragmatic decisions we have taken. We report the numerous studies that have relied upon this technical implementation as a proof of its robustness and polyvalence; moreover, we conduct an additional validation of its applicability to the natural language domain by designing an information exchange task as a benchmark., This work is supported by the EU FP7 project WYSIWYD (FP7-ICT-612139) and by A*STAR JCO grant #1335H00098. We would like to thank Luke Boorman for his contribution to the final version of this manuscript.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The impact of cortical lesions on thalamo-cortical network dynamics after acute ischaemic stroke: a combined experimental and theoretical study

  • Van Wijngaarden, Joeri B. G.
  • Zucca, Riccardo
  • Finnigan, Simon
  • Verschure, Paul F. M. J.
The neocortex and thalamus provide a core substrate for perception, cognition, and action, and are interconnected through different direct and indirect pathways that maintain specific dynamics associated with functional states including wakefulness and sleep. It has been shown that a lack of excitation, or enhanced subcortical inhibition, can disrupt this system and drive thalamic nuclei into an attractor state of low-frequency bursting and further entrainment of thalamo-cortical circuits, also called thalamo-cortical dysrhythmia (TCD). The question remains however whether similar TCD-like phenomena can arise with a cortical origin. For instance, in stroke, a cortical lesion could disrupt thalamo-cortical interactions through an attenuation of the excitatory drive onto the thalamus, creating an imbalance between excitation and inhibition that can lead to a state of TCD. Here we tested this hypothesis by comparing the resting-state EEG recordings of acute ischaemic stroke patients (N = 21) with those of healthy, age-matched control-subjects (N = 17). We observed that these patients displayed the hallmarks of TCD: a characteristic downward shift of dominant α-peaks in the EEG power spectra, together with increased power over the lower frequencies (δ and θ-range). Contrary to general observations in TCD, the patients also displayed a broad reduction in β-band activity. In order to explain the genesis of this stroke-induced TCD, we developed a biologically constrained model of a general thalamocortical module, allowing us to identify the specific cellular and network mechanisms involved. Our model showed that a lesion in the cortical component leads to sustained cell membrane hyperpolarization in the corresponding thalamic relay neurons, that in turn leads to the de-inactivation of voltage-gated T-type Ca2+-channels, switching neurons from tonic spiking to a pathological bursting regime. This thalamic bursting synchronises activity on a population level through divergent intrathalamic circuits, and entrains thalamo-cortical pathways by means of propagating low-frequency oscillations beyond the restricted region of the lesion. Hence, pathological stroke-induced thalamo-cortical dynamics can be the source of diaschisis, and account for the dissociation between lesion location and non-specific symptoms of stroke such as neuropathic pain and hemispatial neglect., This work was supported by the European Research Council under the European Union's Seventh Framework Programme FP7/2007-2013/ERC grant agreement n. 341196 [CDAC], and the Research and Technological Development Programme FP7-ICT-612139 in the WYSIWYD project to PFMJV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.