Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

iCub-HRI: a software framework for complex human-robot interaction scenarios on the iCub humanoid robot

  • Fischer, Tobias
  • Puigbò Llobet, Jordi-Ysard
  • Camilleri, Daniel
  • Nguyen, Phuong D.H.
  • Moulin-Frier, Clément
  • Lallée, Stéphane
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Verschure, Paul F. M. J.
Generating complex, human-like behavior in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, and touch detection), object manipulation (basic and complex motor actions), and social interaction (speech synthesis and joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human–robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behavior and expression of a verbal narrative of the robot’s experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarizing themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community., The research leading to these results has received funding under the European Union’s Seventh Framework Programme (FP/2007-2013)/ERC Grant Agreement n. FP7-ICT-612139 (WYSIWYD—What You Say Is What You Did) and FP7-ICT-270490 (EFAA—The Experimental Functional Android Assistant). PN was supported by a Marie Curie Early Stage Researcher Fellowship (H2020-MSCA-ITA, SECURE 642667). PV was supported by the ERC advanced grant 341196 (cDAC—Role of Consciousness in Adaptive Behavior).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

DAC-h3: a proactive robot cognitive architecture to acquire and express knowledge about the world and the self

  • Moulin-Frier, Clément
  • Fischer, Tobias
  • Petit, Maxime
  • Pointeau, Grégoire
  • Puigbò Llobet, Jordi-Ysard
  • Pattacini, Ugo
  • Ching Low, Sock
  • Camilleri, Daniel
  • Nguyen, Phuong
  • Hoffmann, Matej
  • Jin Chang, Hyung
  • Zambelli, Martina
  • Mealier, Anne-Laure
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Ford Dominey, Peter
  • Verschure, Paul F. M. J.
This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both human and robot. The framework, based on a biologically grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users., This work was supported in part by the European Research Council through the European Union’s Seventh Framework Programme (FP/2007–2013), in part by the ERC through the What You Say Is What You Did project under Grant FP7-ICT-612139, and in part by the ERC’s CDAC Project—Role of Consciousness in Adaptive Behavior under Grant ERC-2013-ADG 341196. The work of D. Camilleri and T. Prescott was supported by the EU Seventh Framework Programme as part of the Human Brain (HBP-SGA1) under Project 720270. The work of P. Nguyen was supported by the ERC’s H2020 under Grant 642667 (SECURE). The work of M. Hoffmann was supported by the Czech Science Foundation under Project GA17-15697Y.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

DAC-h3: a proactive robot cognitive architecture to acquire and express knowledge about the world and the self

  • Moulin-Frier, Clément
  • Fischer, Tobias
  • Petit, Maxime
  • Pointeau, Grégoire
  • Puigbò Llobet, Jordi-Ysard
  • Pattacini, Ugo
  • Ching Low, Sock
  • Camilleri, Daniel
  • Nguyen, Phuong
  • Hoffmann, Matej
  • Jin Chang, Hyung
  • Zambelli, Martina
  • Mealier, Anne-Laure
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Ford Dominey, Peter
  • Verschure, Paul F. M. J.
This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both human and robot. The framework, based on a biologically grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users., This work was supported in part by the European Research Council through the European Union’s Seventh Framework Programme (FP/2007–2013), in part by the ERC through the What You Say Is What You Did project under Grant FP7-ICT-612139, and in part by the ERC’s CDAC Project—Role of Consciousness in Adaptive Behavior under Grant ERC-2013-ADG 341196. The work of D. Camilleri and T. Prescott was supported by the EU Seventh Framework Programme as part of the Human Brain (HBP-SGA1) under Project 720270. The work of P. Nguyen was supported by the ERC’s H2020 under Grant 642667 (SECURE). The work of M. Hoffmann was supported by the Czech Science Foundation under Project GA17-15697Y.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

iCub-HRI: a software framework for complex human-robot interaction scenarios on the iCub humanoid robot

  • Fischer, Tobias
  • Puigbò Llobet, Jordi-Ysard
  • Camilleri, Daniel
  • Nguyen, Phuong D.H.
  • Moulin-Frier, Clément
  • Lallée, Stéphane
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Verschure, Paul F. M. J.
Generating complex, human-like behavior in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, and touch detection), object manipulation (basic and complex motor actions), and social interaction (speech synthesis and joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human–robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behavior and expression of a verbal narrative of the robot’s experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarizing themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community., The research leading to these results has received funding under the European Union’s Seventh Framework Programme (FP/2007-2013)/ERC Grant Agreement n. FP7-ICT-612139 (WYSIWYD—What You Say Is What You Did) and FP7-ICT-270490 (EFAA—The Experimental Functional Android Assistant). PN was supported by a Marie Curie Early Stage Researcher Fellowship (H2020-MSCA-ITA, SECURE 642667). PV was supported by the ERC advanced grant 341196 (cDAC—Role of Consciousness in Adaptive Behavior).