Pasar al contenido principal

COLABORACION ROBOT-HUMANO PARA EL TRANSPORTE Y ENTREGA DE MERCANCIAS

PID2019-106702RB-C21

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 24
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Collaborative-AI: Social robots accompanying and approaching people

  • Sanfeliu, Alberto
  • Repiso, Ely
  • Garrell, Anaís
Trabajo presentado en el International First International Workshop on New Foundations for Human-Centered AI (NeHuAI), celebrado en Santiago de Compostela (España), el 4 de septiembre de 2020, Collaborative AI to approach or to accompany people using social robots will be a fundamental robotics field in the near future. If we desire to share and to collaborate with social robots during the development of our daily task, social robots should be able to develop Collaborative AI task, such us accompanying or approaching people. In this article, we will present the robot-people accompaniment and approaching missions through the four levels of abstractions of Collaborative AI systems and describe the main Collaborative AI functionalities that are needed for these missions. We will also show the system that we have developed for accompany one or two pedestrians and approaching on person by a robot in an urban space, Work supported by the Spanish Ministry of Science project ROCOTRANSP (PID2019-106702RB-C21-RAEI/FEDER EU) by Ministerio de Ciencia e Innovacion , the EU AI4EU project (H2020-ICT-2018-2-825619), by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI (MDM-2016-0656). Ely Repiso is suported by the FPI-grant, BES-2014-067713.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Attention deep learning based model for predicting the 3D human body pose using the robot human handover phases

  • Laplaza Galindo, Javier
  • Pumarola, Albert
  • Moreno-Noguer, Francesc
  • Sanfeliu, Alberto
Trabajo presentado en el International Symposium on Robot and Human Interactive Communication (RO-MAN), celebrado en Vancouver (Canadá), del 8 al 12 de agosto de 2021, This work proposes a human motion prediction model for handover operations. We use in this work, the different phases of the handover operation to improve the human motion predictions. Our attention deep learning based model takes into account the position of the robot’s End Effector (REE) and the phase in the handover operation to predict future human poses. Our model outputs a distribution of possible positions rather than one deterministic position, a key feature in order to allow robots to collaborate with humans. We provide results of the human upper body and the human right hand, also referred as Human End Effector (HEE).The attention deep learning based model has been trained and evaluated with a dataset created using human volunteers and an anthropomorphic robot, simulating handover operations where the robot is the giver and the human the receiver. For each operation, the human skeleton is obtained with an Intel RealSense D435i camera attached inside the robot’s head. The results shown a great improvement of the human’s right hand prediction and 3D body compared with other methods., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), the ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT2020-2-101016906)
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Perception-intention-action cycle as a human acceptable way for improving human-robot collaborative tasks

  • Domínguez Vidal, José Enrique|||0000-0002-0397-9248
  • Rodríguez Linares, Nicolás Adrián|||0000-0003-4834-223X
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© ACM 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, https://doi.org/10.1145/3568294.3580149., In Human-Robot Collaboration (HRC) tasks, the classical Perception-Action cycle can not fully explain the collaborative behaviour of the human-robot pair until it is extended to Perception-Intention-Action (PIA) cycle, giving to the human's intention a key role at the same level of the robot's perception and not as a subblock of this. Although part of the human's intention can be perceived or inferred by the other agent, this is prone to misunderstandings so the true intention has to be explicitly informed in some cases to fulfill the task. Here, we explore both types of intention and we combine them with the robot's perception through the concept of Situation Awareness (SA). We validate the PIA cycle and its acceptance by the user with a preliminary experiment in an object transportation task showing that its usage can increase trust in the robot., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

The LogiSmile project: piloting autonomous vehicles for lastmile logistics in European cities

  • Lemardelé, Clément|||0000-0003-1673-6509
  • Baldó Canut, Albert
  • Pagès Giralt, Laia|||0000-0002-1608-6326
  • Aniculaesei, Adina
  • Rausch, Andreas
  • Conill de Azpiazu, Maria
  • Everding, Lars
  • Hegerhorst, Torben
  • Henze, Roman
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
The use of autonomous technologies for last-mile logistics has the potential to reduce operation costs, cut emissions from the delivery sector, improve safety levels in communities, and provide efficient delivery solutions in areas which experience access regulations. Unfortunately, the implementation of real-life, economically-sustainable, and safe use cases in open urban environments remains scarce, especially in Europe. As a consequence, there is a real need for pilot tests of innovative delivery schemes based on autonomous technologies, not only in numerical simulations, but also in representative urban settings throughout Europe. In this paper, we will present the LogiSmile project, in which a consortium of European partners is piloting a transport management system for autonomous last-mile logistics. Beyond describing the delivery characteristics and use cases of this system, we also highlight the lessons learnt during the course of the project about managing innovation in the urban mobility field, gathering insight form the innovation triple helix (academia, industry and public sector)., The authors would like to acknowledge the participation of all LogiSmile partners in the project and the EIT Urban Mobility for its support. The LogiSmile project was co-funded by the EIT UM under the KAVA 22140. This work was also partially supported by the Spanish Ministry of Science and Innovation under the project AUDEL (TED2021-131759A-I00, funded by MCIN/AEI/10.13039/501100011033 and by the "European Union NextGenerationEU/ PRTR"), the project ROCOTRANSP (PID2019-106702RB-C2 funded by MCIN/ AEI /10.13039/501100011033) and by the Consolidated Research Group RAIG (2021 SGR 00510) of the Departament de Recerca i Universitats de la Generalitat de Catalunya.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Improving human-robot interaction effectiveness in human-robot collaborative object transportation using force prediction

  • Domínguez Vidal, José Enrique|||0000-0002-0397-9248
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., In this work, we analyse the use of a prediction of the human’s force in a Human-Robot collaborative object transportation task at a middle distance. We check that this force prediction can improve multiple parameters associated with effective Human-Robot Interaction (HRI) such as percep- tion of the robot’s contribution to the task, comfort or trust in the robot in a physical Human Robot Interaction (pHRI). We present a Deep Learning model that allows to predict the force that a human will exert in the next 1 s using as inputs the force previously exerted by the human, the robot’s velocity and environment information obtained from the robot’s LiDAR. Its success rate is up to 92.3% in testset and up to 89.1% in real experiments. We demonstrate that this force prediction, in addition to being able to be used directly to detect changes in the human’s intention, can be processed to obtain an estimate of the human’s desired trajectory. We have validated this approach with a user study involving 18 volunteers., Work supported under the European project CANOPIES (H2020 ICT-2020-2-101016906) and the MINECO/AEI ROCOTRANSP project (PID2019-106702RB-C21 / AEI /10.13039/501100011033) and by JST Moonshot R&D Grant Number JPMJMS2011.The first author acknowledges Spanish FPU grant with ref.FPU19/06582., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Human acceptance in the Human-Robot Interaction scenario for last-mile goods delivery

  • Puig-Pey Clavería, Ana María|||0000-0002-6073-7448
  • Zamora i Mestre, Joan-Lluís|||0000-0002-7705-6171
  • Amante García, Beatriz|||0000-0001-5231-1706
  • Moreno Sanz, Joan|||0000-0003-2342-3308
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Grau Saldes, Antoni|||0000-0003-4112-3325
  • Bolea Monte, Yolanda|||0000-0002-7075-9878
  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The introduction of robotic technology in an existing scenario must be analyzed from the point of view of all the human roles involved in that scenario. In the case of dealing with urban public space, the analysis must consider a large group of citizens who carry out different activities on it. The purpose of this article is to analyze the human roles and the human acceptance when the robotic technology is introduced in the last mile distribution of goods in urban areas. In this work, we start with the description of the Human-Robot Interaction (HRI) scenario for last mile goods delivery, we describe the human roles and we propose a set of relevant indicators to evaluate the human acceptance for this task. Finally, we evaluate the human acceptance through qualitative interviews and quantitative surveys. The study has been done for the peer end-users and bystanders human roles and around 100 people participated., Work supported under the European project LogiSmile with the grant (EIT-UM-2020-22140) and by the Spanish State Research Agency through the ROCOTRANSP project with the grant (PID2019-106702RB-C21 / AEI / 10.13039/501100011033) and AUDEL project (TED2021-131759A-I00)), Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Attention deep learning based model for predicting the 3D Human Body Pose using the Robot Human Handover Phases

  • Laplaza Galindo, Javier|||0000-0003-4864-5759
  • Pumarola Peris, Albert|||0000-0003-4185-6991
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., This work proposes a human motion prediction model for handover operations. We use in this work, the different phases of the handover operation to improve the human motion predictions. Our attention deep learning based model takes into account the position of the robot’s End Effector and the phase in the handover operation to predict future human poses. Our model outputs a distribution of possible positions rather than one deterministic position, a key feature in order to allow robots to collaborate with humans. The attention deep learning based model has been trained and evaluated with a dataset created using human volunteers and an anthropomorphic robot, simulating handover operations where the robot is the giver and the human the receiver. For each operation, the human skeleton is obtained with an Intel RealSense D435i camera attached inside the robot’s head. The results shown a great improvement of the human’s right hand prediction and 3D body compared with other methods., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656), the ROCOTRANSP project (PID2019-106702RB-C21 / AEI /10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT-2020-2-101016906), Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Classification of humans social relations within urban areas

  • Castro Arcusa, Oscar
  • Repiso Polo, Ely|||0000-0001-6540-8347
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
This paper presents the design of deep learning architectures which allow to classify the social relationship existing between two people who are walking in a side-by-side formation into four possible categories --colleagues, couple, family or friendship. The models are developed using Neural Networks or Recurrent Neural Networks to achieve the classification and are trained and evaluated using a database obtained from humans walking together in an urban environment. The best achieved model accomplishes a good accuracy in the classification problem and its results enhance the outcomes from a previous study [1]. In addition, we have developed several models to classify the social interactions in two categories --“intimate" and "acquaintances", where the best model achieves a very good performance, and for a real robot this classification is enough to be able to customize its behavior to its users. Furthermore, the proposed models show their future potential to improve its efficiency and to be implemented in a real robot., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Collaborative-AI: Social robots accompanying and approaching people

  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Repiso Polo, Ely|||0000-0001-6540-8347
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
Collaborative AI to approach or to accompany people using social robots will be a fundamental robotics field in the near future. If we desire to share and to collaborate with social robots during the development of our daily task, social robots should be able to develop Collaborative AI task, such us accompanying or approaching people. In this article, we will present the robot-people accompaniment and approaching missions through the four levels of abstractions of Collaborative AI systems and describe the main Collaborative AI functionalities that are needed for these missions. We will also show the system that we have developed for accompany one or two pedestrians and approaching on person by a robot in an urban space., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative multi-agent path planning using Monte Carlo tree search and social reward sources

  • Dalmasso Blanch, Marc|||0000-0003-1734-7863
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Domínguez Vidal, José Enrique|||0000-0002-0397-9248
  • Jiménez Schlegl, Pablo|||0000-0003-3627-4938
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, The collaboration between humans and robots in an object search task requires the achievement of shared plans obtained from communicating and negotiating. In this work, we assume that the robot computes, as a first step, a multiagent plan for both itself and the human. Then, both plans are submitted to human scrutiny, who either agrees or modifies it forcing the robot to adapt its own restrictions or preferences. This process is repeated along the search task as many times as required by the human. Our planner is based on a decentralized variant of Monte Carlo Tree Search (MCTS), with one robot and one human as agents. Moreover, our algorithm allows the robot and the human to optimize their own actions by maintaining a probability distribution over the plans in a joint action space. The method allows an objective function definition over action sequences, it assumes intermittent communication, it is anytime and suitable for on-line replanning. To test it, we have developed a human-robot communication mobile phone interface. Validation is provided by real-life search experiments of a Parcheesi token in an urban space, including also an acceptability study., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033), TERRINet (H2020-INFRAIA-2017-1-two-stage730994) and AI4EU (H2020-ICT-2018-2-825619), Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Context and intention for 3D human motion prediction: experimentation and user study in handover tasks

  • Laplaza Galindo, Javier|||0000-0003-4864-5759
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., In this work we present a novel attention deep learning model that uses context and human intention for 3D human body motion prediction in handover human-robot tasks. This model uses a multi-head attention architecture which incorporates as inputs the human motion, the robot end effector and the position of the obstacles. The outputs of the model are the predicted motion of the human body and the predicted human intention. We use this model to analyze a handover collaborative task with a robot where the robot is able to predict the future motion of the human and use this information in it’s planner. Several experiments are performed where human volunteers fill a standard poll to rate different features, taking into account when the robot uses the prediction versus when the robot doesn’t use the prediction., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), the ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT2020-2-101016906)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

User-friendly smartphone interface to share knowledge in human-robot collaborative search tasks

  • Domínguez Vidal, José Enrique|||0000-0002-0397-9248
  • Torres Rodriguez, Ivan Jesús
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Long-distance human-robot collaborative tasks require robust forms of knowledge-sharing among agents in order to optimize the performance of the task. In this paper, we propose to take advantage of the proliferation of mobile phones to use them as a reliable low-cost communication interface, as opposed to the use of specific gadgets or speech and gesture recognition techniques that are highly prone to failure in the presence of noise or occlusions. Our interface is focused on search tasks, and it allows the user to share with the other agents real-time information such as their position, their intention or even what they would like the other agents to do. To test its acceptability, a user study was conducted with 20 volunteers in a human-human scenario. A second round of experiments with other 30 volunteers was conducted to test different ways to encourage user interaction with our interface. Finally, real-life experiments were also conducted with a robot to apply skills learned to the desired scenario. We found a statistically significant improvement in the amount of information exchanged between agents., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656) and ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Context attention: human motion prediction using context information and deep learning attention models

  • Laplaza Galindo, Javier|||0000-0003-4864-5759
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
This work proposes a human motion prediction model for handover operations. The model uses a multi-headed attention architecture to process the human skeleton data together with contextual data from the operation. This contextual data consists on the position of the robot’s End Effector (REE). The model input is a sequence of 5 seconds skeleton position and it outputs the predicted 2.5 future seconds position. We provide results of the human upper body and the human right hand or Human End Effector (HEE). The attention deep learning based model has been trained and evaluated with a dataset created using human volunteers and an anthropomorphic robot, simulating handover operations where the robot is the giver and the human the receiver. For each operation, the human skeleton is obtained using OpenPose with an Intel RealSense D435i camera set inside the robot’s head. The results show a great improvement of the human’s right hand prediction and 3D body compared with other methods., Work supported under the Spanish State Research Agency through the ROCOTRANSP project (PID2019-106702RB-C21/AEI/10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT-2020-2-101016906)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Collaborative-AI: Social robots accompanying and approaching people

  • Sanfeliu Cortés, Alberto
  • Repiso Polo, Ely
  • Garrell Zulueta, Anais
Collaborative AI to approach or to accompany people using social robots will be a fundamental robotics field in the near future. If we desire to share and to collaborate with social robots during the development of our daily task, social robots should be able to develop Collaborative AI task, such us accompanying or approaching people. In this article, we will present the robot-people accompaniment and approaching missions through the four levels of abstractions of Collaborative AI systems and describe the main Collaborative AI functionalities that are needed for these missions. We will also show the system that we have developed for accompany one or two pedestrians and approaching on person by a robot in an urban space., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative multi-agent path planning using Monte Carlo tree search and social reward sources

  • Dalmasso Blanch, Marc
  • Garrell Zulueta, Anais
  • Domínguez Vidal, José Enrique
  • Jiménez Schlegl, Pablo
  • Sanfeliu Cortés, Alberto
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, The collaboration between humans and robots in an object search task requires the achievement of shared plans obtained from communicating and negotiating. In this work, we assume that the robot computes, as a first step, a multiagent plan for both itself and the human. Then, both plans are submitted to human scrutiny, who either agrees or modifies it forcing the robot to adapt its own restrictions or preferences. This process is repeated along the search task as many times as required by the human. Our planner is based on a decentralized variant of Monte Carlo Tree Search (MCTS), with one robot and one human as agents. Moreover, our algorithm allows the robot and the human to optimize their own actions by maintaining a probability distribution over the plans in a joint action space. The method allows an objective function definition over action sequences, it assumes intermittent communication, it is anytime and suitable for on-line replanning. To test it, we have developed a human-robot communication mobile phone interface. Validation is provided by real-life search experiments of a Parcheesi token in an urban space, including also an acceptability study., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033), TERRINet (H2020-INFRAIA-2017-1-two-stage730994) and AI4EU (H2020-ICT-2018-2-825619), Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Context attention: human motion prediction using context information and deep learning attention models

  • Laplaza Galindo, Javier
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto
This work proposes a human motion prediction model for handover operations. The model uses a multi-headed attention architecture to process the human skeleton data together with contextual data from the operation. This contextual data consists on the position of the robot’s End Effector (REE). The model input is a sequence of 5 seconds skeleton position and it outputs the predicted 2.5 future seconds position. We provide results of the human upper body and the human right hand or Human End Effector (HEE). The attention deep learning based model has been trained and evaluated with a dataset created using human volunteers and an anthropomorphic robot, simulating handover operations where the robot is the giver and the human the receiver. For each operation, the human skeleton is obtained using OpenPose with an Intel RealSense D435i camera set inside the robot’s head. The results show a great improvement of the human’s right hand prediction and 3D body compared with other methods., Work supported under the Spanish State Research Agency through the ROCOTRANSP project (PID2019-106702RB-C21/AEI/10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT-2020-2-101016906)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Context and intention for 3D human motion prediction: experimentation and user study in handover tasks

  • Laplaza Galindo, Javier
  • Garrell Zulueta, Anais
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., In this work we present a novel attention deep learning model that uses context and human intention for 3D human body motion prediction in handover human-robot tasks. This model uses a multi-head attention architecture which incorporates as inputs the human motion, the robot end effector and the position of the obstacles. The outputs of the model are the predicted motion of the human body and the predicted human intention. We use this model to analyze a handover collaborative task with a robot where the robot is able to predict the future motion of the human and use this information in it’s planner. Several experiments are performed where human volunteers fill a standard poll to rate different features, taking into account when the robot uses the prediction versus when the robot doesn’t use the prediction., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), the ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT2020-2-101016906)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Improving human-robot interaction effectiveness in human-robot collaborative object transportation using force prediction

  • Domínguez Vidal, José Enrique
  • Sanfeliu Cortés, Alberto
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., In this work, we analyse the use of a prediction of the human’s force in a Human-Robot collaborative object transportation task at a middle distance. We check that this force prediction can improve multiple parameters associated with effective Human-Robot Interaction (HRI) such as percep- tion of the robot’s contribution to the task, comfort or trust in the robot in a physical Human Robot Interaction (pHRI). We present a Deep Learning model that allows to predict the force that a human will exert in the next 1 s using as inputs the force previously exerted by the human, the robot’s velocity and environment information obtained from the robot’s LiDAR. Its success rate is up to 92.3% in testset and up to 89.1% in real experiments. We demonstrate that this force prediction, in addition to being able to be used directly to detect changes in the human’s intention, can be processed to obtain an estimate of the human’s desired trajectory. We have validated this approach with a user study involving 18 volunteers., Work supported under the European project CANOPIES (H2020 ICT-2020-2-101016906) and the MINECO/AEI ROCOTRANSP project (PID2019-106702RB-C21 / AEI /10.13039/501100011033) and by JST Moonshot R&D Grant Number JPMJMS2011.The first author acknowledges Spanish FPU grant with ref.FPU19/06582., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Classification of humans social relations within urban areas

  • Castro Arcusa, Oscar
  • Repiso Polo, Ely
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
This paper presents the design of deep learning architectures which allow to classify the social relationship existing between two people who are walking in a side-by-side formation into four possible categories --colleagues, couple, family or friendship. The models are developed using Neural Networks or Recurrent Neural Networks to achieve the classification and are trained and evaluated using a database obtained from humans walking together in an urban environment. The best achieved model accomplishes a good accuracy in the classification problem and its results enhance the outcomes from a previous study [1]. In addition, we have developed several models to classify the social interactions in two categories --“intimate" and "acquaintances", where the best model achieves a very good performance, and for a real robot this classification is enough to be able to customize its behavior to its users. Furthermore, the proposed models show their future potential to improve its efficiency and to be implemented in a real robot., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Human acceptance in the Human-Robot Interaction scenario for last-mile goods delivery

  • Puig-Pey Clavería, Ana María
  • Zamora i Mestre, Joan-Lluís
  • Amante García, Beatriz
  • Moreno Sanz, Joan
  • Garrell Zulueta, Anais
  • Grau Saldes, Antoni
  • Bolea Monte, Yolanda
  • Santamaria Navarro, Àngel
  • Sanfeliu Cortés, Alberto
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The introduction of robotic technology in an existing scenario must be analyzed from the point of view of all the human roles involved in that scenario. In the case of dealing with urban public space, the analysis must consider a large group of citizens who carry out different activities on it. The purpose of this article is to analyze the human roles and the human acceptance when the robotic technology is introduced in the last mile distribution of goods in urban areas. In this work, we start with the description of the Human-Robot Interaction (HRI) scenario for last mile goods delivery, we describe the human roles and we propose a set of relevant indicators to evaluate the human acceptance for this task. Finally, we evaluate the human acceptance through qualitative interviews and quantitative surveys. The study has been done for the peer end-users and bystanders human roles and around 100 people participated., Work supported under the European project LogiSmile with the grant (EIT-UM-2020-22140) and by the Spanish State Research Agency through the ROCOTRANSP project with the grant (PID2019-106702RB-C21 / AEI / 10.13039/501100011033) and AUDEL project (TED2021-131759A-I00)), Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The LogiSmile project: piloting autonomous vehicles for lastmile logistics in European cities

  • Lemardelé, Clément
  • Baldó Canut, Albert
  • Pagès Giralt, Laia
  • Aniculaesei, Adina
  • Rausch, Andreas
  • Conill de Azpiazu, Maria
  • Everding, Lars
  • Hegerhorst, Torben
  • Henze, Roman
  • Sanfeliu Cortés, Alberto
  • Santamaria Navarro, Àngel
The use of autonomous technologies for last-mile logistics has the potential to reduce operation costs, cut emissions from the delivery sector, improve safety levels in communities, and provide efficient delivery solutions in areas which experience access regulations. Unfortunately, the implementation of real-life, economically-sustainable, and safe use cases in open urban environments remains scarce, especially in Europe. As a consequence, there is a real need for pilot tests of innovative delivery schemes based on autonomous technologies, not only in numerical simulations, but also in representative urban settings throughout Europe. In this paper, we will present the LogiSmile project, in which a consortium of European partners is piloting a transport management system for autonomous last-mile logistics. Beyond describing the delivery characteristics and use cases of this system, we also highlight the lessons learnt during the course of the project about managing innovation in the urban mobility field, gathering insight form the innovation triple helix (academia, industry and public sector)., The authors would like to acknowledge the participation of all LogiSmile partners in the project and the EIT Urban Mobility for its support. The LogiSmile project was co-funded by the EIT UM under the KAVA 22140. This work was also partially supported by the Spanish Ministry of Science and Innovation under the project AUDEL (TED2021-131759A-I00, funded by MCIN/AEI/10.13039/501100011033 and by the "European Union NextGenerationEU/ PRTR"), the project ROCOTRANSP (PID2019-106702RB-C2 funded by MCIN/ AEI /10.13039/501100011033) and by the Consolidated Research Group RAIG (2021 SGR 00510) of the Departament de Recerca i Universitats de la Generalitat de Catalunya., Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

User-friendly smartphone interface to share knowledge in human-robot collaborative search tasks

  • Domínguez Vidal, José Enrique
  • Torres Rodriguez, Ivan Jesús
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Long-distance human-robot collaborative tasks require robust forms of knowledge-sharing among agents in order to optimize the performance of the task. In this paper, we propose to take advantage of the proliferation of mobile phones to use them as a reliable low-cost communication interface, as opposed to the use of specific gadgets or speech and gesture recognition techniques that are highly prone to failure in the presence of noise or occlusions. Our interface is focused on search tasks, and it allows the user to share with the other agents real-time information such as their position, their intention or even what they would like the other agents to do. To test its acceptability, a user study was conducted with 20 volunteers in a human-human scenario. A second round of experiments with other 30 volunteers was conducted to test different ways to encourage user interaction with our interface. Finally, real-life experiments were also conducted with a robot to apply skills learned to the desired scenario. We found a statistically significant improvement in the amount of information exchanged between agents., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656) and ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Perception-intention-action cycle as a human acceptable way for improving human-robot collaborative tasks

  • Domínguez Vidal, José Enrique
  • Rodríguez Linares, Nicolás Adrián
  • Sanfeliu Cortés, Alberto
© ACM 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in HRI '23: Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction, https://doi.org/10.1145/3568294.3580149., In Human-Robot Collaboration (HRC) tasks, the classical Perception-Action cycle can not fully explain the collaborative behaviour of the human-robot pair until it is extended to Perception-Intention-Action (PIA) cycle, giving to the human's intention a key role at the same level of the robot's perception and not as a subblock of this. Although part of the human's intention can be perceived or inferred by the other agent, this is prone to misunderstandings so the true intention has to be explicitly informed in some cases to fulfill the task. Here, we explore both types of intention and we combine them with the robot's perception through the concept of Situation Awareness (SA). We validate the PIA cycle and its acceptance by the user with a preliminary experiment in an object transportation task showing that its usage can increase trust in the robot., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Attention deep learning based model for predicting the 3D Human Body Pose using the Robot Human Handover Phases

  • Laplaza Galindo, Javier
  • Pumarola Peris, Albert
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., This work proposes a human motion prediction model for handover operations. We use in this work, the different phases of the handover operation to improve the human motion predictions. Our attention deep learning based model takes into account the position of the robot’s End Effector and the phase in the handover operation to predict future human poses. Our model outputs a distribution of possible positions rather than one deterministic position, a key feature in order to allow robots to collaborate with humans. The attention deep learning based model has been trained and evaluated with a dataset created using human volunteers and an anthropomorphic robot, simulating handover operations where the robot is the giver and the human the receiver. For each operation, the human skeleton is obtained with an Intel RealSense D435i camera attached inside the robot’s head. The results shown a great improvement of the human’s right hand prediction and 3D body compared with other methods., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656), the ROCOTRANSP project (PID2019-106702RB-C21 / AEI /10.13039/501100011033)) and the EU project CANOPIES (H2020- ICT-2020-2-101016906), Peer Reviewed, Postprint (author's final draft)