Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

TORNADO: Foundation models for robots that handle small, soft and deformable objects

  • Moutousi, Maria
  • El Saer, Andreas
  • Nikolaou, Nikos
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anaís
  • Bláha, Lukáš
  • Čech, Martin
  • Markakis, Evangelos K.
  • Kefaloukos, Ioannis
  • Lagomarsino, Marta
  • Margetis, George
  • Adamakis, Emmanouil
  • Poulakidas, Athanasios
  • Lykokanellos, Filopoimin
  • Stefanidou, Artemis
  • Cani, Jorgen
  • Radoglou-Grammatikis, Panagiotis
  • Siganos, Marios
  • Ajoudani, Arash
  • Papadopoulos, Georgios Th.
Trabajo presentado en el 6th International Conference in Electronic Engineering & Information Technology (EEITE), celebrado en Chania (Grecia), del 4 al 6 de junio de 2025, This paper introduces TORNADO, a cloud-integrated robotics platform designed to tackle the challenges of autonomous manipulation in dynamic indoor environments, particularly those involving small, soft, or deformable objects. TORNADO integrates large-scale foundation models for perception, language comprehension, and high-level reasoning, to achieve strong zero-shot generalization across a wide range of tasks. At its core, the platform features an adaptive cognitive pipeline capable of dynamically reconfiguring its modules—including semantic 3D SLAM, people-aware navigation, dexterous manipulation, and human-in-the-loop learning—to manage uncertainty and adapt to changing conditions. Additionally, TORNADO incorporates a multi-modal Learning-from-Demonstration interface and an Explainable AI engine, enhancing transparency and easing the burden of teaching new tasks. The system is validated through three industry-relevant scenarios: (1) flexible gear and ply-sheet handling in a mechanical parts factory, (2) patient support in a hospital palliative ward, and (3) product sampling and waste management in a distribution center. TORNADO aims to significantly improve the agility, safety, and overall task performance of mobile manipulators operating in dynamic, human-centric environments., The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. The work was supported by the European Union through the research and innovation program under Grant No. 101189557 (TORNADO). In addition, certain sections may include content generated or refined by AI, any of which has been carefully reviewed, edited, and integrated by the authors., Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

TORNADO: foundation models for robots that handle small, soft and deformable objects

  • Moutousi, Maria
  • El Saer, Andreas
  • Nikolaou, Nikos
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Markakis, Evangelos
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., This paper introduces TORNADO, a cloud-integrated robotics platform designed to tackle the challenges of autonomous manipulation in dynamic indoor environments, particularly those involving small, soft, or deformable objects. TORNADO integrates large-scale foundation models for perception, language comprehension, and high-level reasoning, to achieve strong zero-shot generalization across a wide range of tasks. At its core, the platform features an adaptive cognitive pipeline capable of dynamically reconfiguring its modules—including semantic 3D SLAM, people-aware navigation, dexterous manipulation, and human-in-the-loop learning—to manage uncertainty and adapt to changing conditions. Additionally, TORNADO incorporates a multi-modal Learning-from-Demonstration interface and an Explainable AI engine, enhancing transparency and easing the burden of teaching new tasks. The system is validated through three industry-relevant scenarios: (1) flexible gear and ply-sheet handling in a mechanical parts factory, (2) patient support in a hospital palliative ward, and (3) product sampling and waste management in a distribution center. TORNADO aims to significantly improve the agility, safety, and overall task performance of mobile manipulators operating in dynamic, human-centric environments., The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. The work was supported by the European Union through the research and innovation program under Grant No. 101189557 (TORNADO). In addition, certain sections may include content generated or refined by AI, any of which has been carefully reviewed, edited, and integrated by the authors., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

AI or human? Understanding perceptions of embodied robots with LLMs

  • Hriscu Acsinte-Staut, Lavinia Beatrice
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The pursuit of artificial intelligence has long been associated to the the challenge of effectively measuring intelligence. Even if the Turing Test was introduced as a means of assessing a system's intelligence, its relevance and application within the field of human-robot interaction remain largely underexplored. This study investigates the perception of intelligence in embodied robots by performing a Turing Test within a robotic platform. A total of 34 participants were tasked with distinguishing between AI- and human-operated robots while engaging in two interactive tasks: an information retrieval and a package handover. These tasks assessed the robot’s perception and navigation abilities under both static and dynamic conditions. Results indicate that participants were unable to reliably differentiate between AI- and human-controlled robots beyond chance levels. Furthermore, analysis of participant responses reveals key factors influencing the perception of artificial versus human intelligence in embodied robotic systems. These findings provide insights into the design of future interactive robots and contribute to the ongoing discourse on intelligence assessment in AI-driven systems., This work has been supported by JST Moonshot R & D (JPMJMS2011-85) and the European project TORNADO with grant number HORIZONCL4-2024-DIGITAL-EMERGING-01-101189557, Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

TORNADO: foundation models for robots that handle small, soft and deformable objects

  • Moutousi, Maria
  • El Saer, Andreas
  • Nikolaou, Nikos
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anais
  • Markakis, Evangelos
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., This paper introduces TORNADO, a cloud-integrated robotics platform designed to tackle the challenges of autonomous manipulation in dynamic indoor environments, particularly those involving small, soft, or deformable objects. TORNADO integrates large-scale foundation models for perception, language comprehension, and high-level reasoning, to achieve strong zero-shot generalization across a wide range of tasks. At its core, the platform features an adaptive cognitive pipeline capable of dynamically reconfiguring its modules—including semantic 3D SLAM, people-aware navigation, dexterous manipulation, and human-in-the-loop learning—to manage uncertainty and adapt to changing conditions. Additionally, TORNADO incorporates a multi-modal Learning-from-Demonstration interface and an Explainable AI engine, enhancing transparency and easing the burden of teaching new tasks. The system is validated through three industry-relevant scenarios: (1) flexible gear and ply-sheet handling in a mechanical parts factory, (2) patient support in a hospital palliative ward, and (3) product sampling and waste management in a distribution center. TORNADO aims to significantly improve the agility, safety, and overall task performance of mobile manipulators operating in dynamic, human-centric environments., The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. The work was supported by the European Union through the research and innovation program under Grant No. 101189557 (TORNADO). In addition, certain sections may include content generated or refined by AI, any of which has been carefully reviewed, edited, and integrated by the authors., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

AI or human? Understanding perceptions of embodied robots with LLMs

  • Hriscu Acsinte-Staut, Lavinia Beatrice
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anais
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The pursuit of artificial intelligence has long been associated to the the challenge of effectively measuring intelligence. Even if the Turing Test was introduced as a means of assessing a system's intelligence, its relevance and application within the field of human-robot interaction remain largely underexplored. This study investigates the perception of intelligence in embodied robots by performing a Turing Test within a robotic platform. A total of 34 participants were tasked with distinguishing between AI- and human-operated robots while engaging in two interactive tasks: an information retrieval and a package handover. These tasks assessed the robot’s perception and navigation abilities under both static and dynamic conditions. Results indicate that participants were unable to reliably differentiate between AI- and human-controlled robots beyond chance levels. Furthermore, analysis of participant responses reveals key factors influencing the perception of artificial versus human intelligence in embodied robotic systems. These findings provide insights into the design of future interactive robots and contribute to the ongoing discourse on intelligence assessment in AI-driven systems., This work has been supported by JST Moonshot R & D (JPMJMS2011-85) and the European project TORNADO with grant number HORIZONCL4-2024-DIGITAL-EMERGING-01-101189557, Peer Reviewed, Postprint (author's final draft)