Skip to main content

APRENDIZAJE CONTINUO PARA LA NAVEGACION DE ROBOTS CON INTERACCIONES HUMANAS

PID2022-142039NA-I00

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2022
State Plan 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 7
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Negotiation of assignation plans in human-robot team task scheduling

  • Fuster Pala, Llum
  • Dalmasso Blanch, Marc|||0000-0003-1734-7863
  • Aubach Altes, Artur
  • Izquierdo Badiola, Silvia
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., In recent years, considerable attention has been given to improving human-robot collaboration. Despite advances in robotic capabilities and interaction techniques, achieving a fair distribution of tasks remains challenging due to the dynamic nature of human preferences and situational constraints. This paper presents a novel negotiation framework that enables robots to effectively communicate with humans to facilitate fair and adaptive task allocation. Our approach leverages automated planning techniques with the Planning Domain Definition Language (PDDL), explicitly encoding tasks, constraints, and preferences from both human and robotic perspectives. Task allocation is optimized based on three key criteria: the robot’s effort, the human’s effort, and overall task success. Additionally, we integrate a Natural Language Processing (NLP) model that interprets human preferences and informs the negotiation process, ensuring that the robot generates task proposals aligned with human input. The negotiation follows an alternating-offer protocol, with the robot employing a sigmoid conceder strategy to iteratively refine task allocation, leading to balanced and mutually acceptable plans. To evaluate our approach, we conduct a comprehensive user study with non-trained volunteers interacting with the robot, assessing the effectiveness, fairness, and adaptability of the proposed system in real-world scenarios., This work was partially supported by JST Moonshot R, D grant number JPMJMS2011 and LENA project (PID2022-142039NA-I00), funded by MCIN/AEI/10.13039/501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Enhancing context-aware human motion prediction for efficient robot handovers

  • Gomez Izquierdo, Gerard
  • Laplaza Galindo, Javier|||0000-0003-4864-5759
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Accurate human motion prediction (HMP) is critical for seamless human-robot collaboration, particularly in handover tasks that require real-time adaptability. Despite the high accuracy of state-of-the-art models, their computational complexity limits practical deployment in real-world robotic applications. In this work, we enhance human motion forecasting for handover tasks by leveraging siMLPe [1], a lightweight yet powerful architecture, and introducing key improvements. Our approach, named IntentMotion incorporates intention-aware conditioning, task-specific loss functions, and a novel intention classifier, significantly improving motion prediction accuracy while maintaining efficiency. Experimental results demonstrate that our method reduces body loss error by over 50%, achieves 200× faster inference, and requires only 3% of the parameters compared to existing state-of-the-art HMP models in robotics. These advancements establish our framework as a highly efficient and scalable solution for real-time human-robot interaction., This work was partially supported by JST Moonshot R, D grant number JPMJMS2011 and LENA (PID2022-142039NA-I00), funded by MCIN/AEI/10.13039/501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Personalised explainable robots using LLMs

  • Gebellí Guinjoan, Ferran
  • Hriscu Acsinte-Staut, Lavinia Beatrice
  • Ros, Raquel
  • Lemaignan, Séverin
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
In the field of Human-Robot Interaction (HRI), a key challenge lies in enabling humans to comprehend the decisions and behaviours of robots. One promising approach involves leveraging Theory of Mind (ToM) frameworks, wherein a robot estimates the mental model that a user holds about its functioning and compares this with the representation of its internal mental model. This comparison allows the robot to identify potential mismatches and generate communicative actions to bridge such gaps. Effective communication requires the robot to maintain unique mental models for each user and personalise explanations based on past interactions. To address this, we propose an architecture grounded in Large Language Models (LLMs) that operationalises this theoretical framework. We demonstrate the feasibility of this approach through qualitative examples, showcasing responses provided by a robot patrolling a geriatric hospital., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Negotiation of assignation plans in human-robot team task scheduling

  • Fuster Pala, Llum
  • Dalmasso Blanch, Marc
  • Aubach Altes, Artur
  • Izquierdo Badiola, Silvia
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anais
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., In recent years, considerable attention has been given to improving human-robot collaboration. Despite advances in robotic capabilities and interaction techniques, achieving a fair distribution of tasks remains challenging due to the dynamic nature of human preferences and situational constraints. This paper presents a novel negotiation framework that enables robots to effectively communicate with humans to facilitate fair and adaptive task allocation. Our approach leverages automated planning techniques with the Planning Domain Definition Language (PDDL), explicitly encoding tasks, constraints, and preferences from both human and robotic perspectives. Task allocation is optimized based on three key criteria: the robot’s effort, the human’s effort, and overall task success. Additionally, we integrate a Natural Language Processing (NLP) model that interprets human preferences and informs the negotiation process, ensuring that the robot generates task proposals aligned with human input. The negotiation follows an alternating-offer protocol, with the robot employing a sigmoid conceder strategy to iteratively refine task allocation, leading to balanced and mutually acceptable plans. To evaluate our approach, we conduct a comprehensive user study with non-trained volunteers interacting with the robot, assessing the effectiveness, fairness, and adaptability of the proposed system in real-world scenarios., This work was partially supported by JST Moonshot R, D grant number JPMJMS2011 and LENA project (PID2022-142039NA-I00), funded by MCIN/AEI/10.13039/501100011033., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Body gestures recognition for social human-robot interaction

  • Laplaza Galindo, Javier
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anais
In this paper, a solution for human gesture classification is proposed. The solution uses a Deep Learning model and is meant to be useful for non-verbal communication between humans and robots. The research focuses on the creation of the “temPoral bOdy geSTUre REcognition model” (POSTURE) that can recognise continuous gestures performed in real-life situations. The suggested model takes into account spatial and temporal components so as to achieve the recognition of more natural and intuitive gestures. In a first step, a framework extracts from all the images the corresponding landmarks for each of the body joints. Next, some data filtering techniques are applied with the aim of avoiding problems related with the data. And finally, different neural network configurations and approaches are tested to find the optimal performance. The validation of the model is accomplished throughout an extensive set of simulations and real-life experiments., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Enhancing context-aware human motion prediction for efficient robot handovers

  • Gomez Izquierdo, Gerard
  • Laplaza Galindo, Javier
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anais
© 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Accurate human motion prediction (HMP) is critical for seamless human-robot collaboration, particularly in handover tasks that require real-time adaptability. Despite the high accuracy of state-of-the-art models, their computational complexity limits practical deployment in real-world robotic applications. In this work, we enhance human motion forecasting for handover tasks by leveraging siMLPe [1], a lightweight yet powerful architecture, and introducing key improvements. Our approach, named IntentMotion incorporates intention-aware conditioning, task-specific loss functions, and a novel intention classifier, significantly improving motion prediction accuracy while maintaining efficiency. Experimental results demonstrate that our method reduces body loss error by over 50%, achieves 200× faster inference, and requires only 3% of the parameters compared to existing state-of-the-art HMP models in robotics. These advancements establish our framework as a highly efficient and scalable solution for real-time human-robot interaction., This work was partially supported by JST Moonshot R, D grant number JPMJMS2011 and LENA (PID2022-142039NA-I00), funded by MCIN/AEI/10.13039/501100011033., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Personalised explainable robots using LLMs

  • Gebellí Guinjoan, Ferran
  • Hriscu Acsinte-Staut, Lavinia Beatrice
  • Ros, Raquel
  • Lemaignan, Séverin
  • Sanfeliu Cortés, Alberto
  • Garrell Zulueta, Anais
In the field of Human-Robot Interaction (HRI), a key challenge lies in enabling humans to comprehend the decisions and behaviours of robots. One promising approach involves leveraging Theory of Mind (ToM) frameworks, wherein a robot estimates the mental model that a user holds about its functioning and compares this with the representation of its internal mental model. This comparison allows the robot to identify potential mismatches and generate communicative actions to bridge such gaps. Effective communication requires the robot to maintain unique mental models for each user and personalise explanations based on past interactions. To address this, we propose an architecture grounded in Large Language Models (LLMs) that operationalises this theoretical framework. We demonstrate the feasibility of this approach through qualitative examples, showcasing responses provided by a robot patrolling a geriatric hospital., Peer Reviewed, Postprint (published version)