Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 26
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Adaptive Side-by-Side Social Robot Navigation to Approach and Interact with People

  • Repiso, Ely
  • Garrell, Anaís
  • Sanfeliu, Alberto
This paper presents a new framework for how autonomous social robots approach and accompany people in urban environments. The method discussed allows the robot to accompany a person and approach to other one, by adapting its own navigation in anticipation of future interactions with other people or contact with static obstacles. The contributions of the paper are manifold: firstly, we extended the Social Force model and the Anticipative Kinodynamic Planner (Ferrer and Sanfeliu, in: IEEE/RSJ international conference on intelligent robots and systems. IEEE, 2014) to the case of an adaptive side-by-side navigation; secondly, we enhance side-by-side navigation with an approaching task and a final positioning that allows the robot to interact with both people; and finally, we use findings from experiments of real-life observations of people walking in pairs to define the parameters of the human–robot interaction in our case of adaptive side-by-side. The method was validated by a large set of simulations; we also conducted real-life experiments with our robot, Tibi, to validate the framework described for the interaction process. In addition, we carried out various surveys and user studies to indicate the social acceptability of the robots performance of the accompanying, approaching and positioning tasks., Work supported by the Spanish Ministry of Science and Innovation under project ColRobTransp (DPI2016-78957-R. AEI/FEDER EU), by the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656) and EU TERRINET project (H2020-INFRAIA-2017-1-two-stage-730994). Ely Repiso is also supported by Spanish Ministry of Science and Innovation under a FPI-grant (BES-2014-067713)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative navigation search using social reward sources

  • Dalmasso, Marc
  • Garrell, Anaís
  • Jiménez, Pablo
  • Sanfeliu, Alberto
Trabajo presentado en el 4th Iberian Robotics Conference, celebrado en Oporto (Portugal) en noviembre de 2019, This paper proposes a Social Reward Sources (SRS) design for a Human-Robot Collaborative Navigation (HRCN) task: human-robot collaborative search. It is a flexible approach capable of handling the collaborative task, human-robot interaction and environment restrictions, all integrated on a common environment. We modelled task rewards based on unexplored area observability and isolation and evaluated the model through different levels of human-robot communication.The models are validated through quantitative evaluation against both agents¿ individual performance and qualitative surveying of participants¿ perception. After that, the three proposed communication levels are com-pared against each other using the previous metrics., Work supported under projects ColRobTransp (DPI2016-78957-RAEI/FEDER EU), TERRINet (H2020-INFRAIA-2017-1-two-stage-730994) and by the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

People's adaptive side-by-side model evolved to accompany groups of people by social robots

  • Repiso, Ely
  • Garrell, Anaís
  • Sanfeliu, Alberto
The presented method implements a robot accompaniment in an adaptive side-by-side formation of a single person or a group of people. The method enhances our previous robot adaptive side-by-side behavior allowing the robot to accompany a group of people, not only one person. Adaptive means that the robot is capable to adjust its position and velocity to the behavior of the group being accompanied, without bothering other pedestrians in the environment, as well as facilitating the group navigation to avoid static and dynamic obstacles. Furthermore, the robot can deal with the random factor of human behavior in several situations. Firstly, if other people interfere in the path of the companions, the robot leaves space for the person of the group that has to avoid those other people, by approaching the other companion. Also, without invading any personal space. Secondly, if the people of the group changes their physical position inside the group formation, then the robot adapts to them dynamically by changing from the lateral position to the central position of the formation or otherwise. Thirdly, the robot adapts to changes in the velocity of people in the group and other people that interfere in the path of the group, in magnitude and orientation. Fourthly, the robot can deal with occlusions of one accompanied person by the other. The method has been validated using synthetic experiments and real-life experiments with our robot. Finally, we developed an user study comparing the method with a Wizard of Oz., Work supported by the Spanish Ministry of Science and Innovation under project ColRobTransp (DPI2016-78957-RAEI/FEDER EU), TERRINet (H2020-INFRAIA-2017-1-two-stage-730994), by the Spanish State Research Agency through the Mar´ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656). Ely Repiso is also suported by Spanish Ministry of Science and Innovation under a FPI-grant, BES-2014-067713
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Event-Based Line SLAM in Real-Time

  • Chamorro Hernández, William Oswaldo
  • Solà, Joan
  • Andrade-Cetto, Juan
Event-based cameras generate asynchronous streams of events, triggered proportionally to the logarithmic change of brightness in the scene. These cameras have very low latency and high dynamic range suitable to address challenging motion scenarios in robotics. In this work, we explore a new event-based line-SLAM approach following a parallel tracking and mapping philosophy. Our fast tracking algorithm, produces accurate camera pose estimates at a high rate by minimizing the event-line reprojection error with an error-state Kalman filter formulated entirely with Lie theory. The mapping thread leverages the natural edge highlighting strength of events to recover and optimize straight lines in human-made scenarios. The proper manipulation of matrix sparsity as well as the information sharing between tracking and mapping nodes allow us to achieve real-time performance on a standard multi-core CPU. This system was tested on several scenarios rich in straight edge objects, and compared against, ground truth and frame and event based state-of-the-art approaches., This work was supported by the EU H2020 projects TERRINET INFRAI-2017-1-730994 and CANOPIES ICT-2020-2-101016906, by project EBCON PID2020- 119244GB-I00 funded by MCIN/AEI/10.13039/501100011033, and by a scholarship from SENESCYT, Republic of Ecuador to WCH.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Wolf: A Modular Estimation Framework for Robotics Based on Factor Graphs

  • Solà, Joan
  • Vallvé, Joan
  • Casalsm Joaquim
  • Deray, Jeremie
  • Fourmy, Mederic
  • Atchuthan, Dinesh
  • Corominas Murtra, Andreu
  • Andrade-Cetto, Juan
This letter introduces Wolf, a C++ estimation framework based on factor graphs and targeted at mobile robotics. Wolf can be used beyond SLAM to handle self-calibration, model identification, or the observation of dynamic quantities other than localization. The architecture of Wolf allows for a modular yet tightly-coupled estimator. Modularity is enhanced via reusable plugins that are loaded at runtime depending on application setup. This setup is achieved conveniently through YAML files, allowing users to configure a wide range of applications without the need of writing or compiling code. Most procedures are coded as abstract algorithms in base classes with varying levels of specialization. Overall, all these assets allow for coherent processing and favor code re-usability and scalability. Wolf can be used with ROS, and is made publicly available and open to collaboration., This work was partially supported by the EU H2020 projects LOGIMATIC (Galileo- 2015-1-687534), GAUSS (Galileo-2017-1-776293), TERRINET (INFRAIA- 2017-1-730994), and MEMMO (ICT-25-2017-1-780684); and by the Spanish State Research Agency through projects EB-SLAM (DPI2017-89564- P), EBCON (PID2020-119244GB-I00), and the Mar´ıa de Maeztu Seal of Excellence to IRI (MDM-2016-0656).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A New Methodological Approach to Analyze Human Roles in Human-Robot Interaction Scenarios

  • Puig-Pey, Ana
  • Sanfeliu, Alberto
  • Leroux, Christoph
  • Dario, Paolo
  • Rasso, Rossela
  • Arrue, Begoña C.
  • Soueres, Philip
  • Dailami, Farid
  • Vasco, Valentina
  • Munih, Marko
  • Ijspeert, Auke
  • Roozing, Wesley
Trabajo presentado en el IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO), celebrado en Long Beach, CA (Estados Unidos), del 28 al 30 de mayo de 2022, The influence of robotics in the job market has socio-economic consequences and the inevitable loss of job positions, but in the Human-Robot Interaction (HRI) scenarios, where humans and robots work together, new jobs and business models will be created. These HRI scenarios can be seen in manufacturing, medicine, maintenance, education, etc. and in the future, in most of the daily tasks. The purpose of this article is to analyze from the perspective of Human-Robot Interaction scenarios, which new HRI human roles and HRI tasks categories has to be taken into account. The new HRI human roles will serve to define and homogenize the transverse skills needed for workers working in HRI scenarios and for analyzing the human roles in HRI experiments. We introduce a methodological approach using the TERRINet HRI Template, which facilitates the analysis of tasks that in the near future will be done by humans working with robots. The Template has been used and tested in 20 study cases of HRI scenarios, validating the methodology and looking for homogenization in human roles., Work supported under the European project TERRINet (H2020- INFRAIA-2017-1-two-stage-730994) and the Spanish State Research Agency through the ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033))
DIGITAL.CSIC. Repositorio Institucional del CSIC
Datos de investigación Set de datos (Dataset)

AEROARMS - Image Dataset for the Crawler Indirect Detection through its Cage

  • Laplaza Galindo, Javier
  • Pumarola, Albert
  • Sanfeliu, Alberto
Dataset containing images and ground-truth position of the crawler's cage used in the AEROARMS project experiments, European Commission: TERRINet - The European Robotics Research Infrastructure Network (730994) AEROARMS - AErial RObotic system integrating multiple ARMS and advanced manipulation capabilities for inspection and maintenance (644271), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Datos de investigación Set de datos (Dataset)

AEROARMS - Crawler Direct Detection Image Dataset

  • Pumarola, Albert
  • Andrade-Cetto, Juan
  • Sanfeliu, Alberto
Dataset containing images and ground-truth position of the crawler used in the AEROARMS project experiments, European Commission: TERRINet - The European Robotics Research Infrastructure Network (730994) AEROARMS - AErial RObotic system integrating multiple ARMS and advanced manipulation capabilities for inspection and maintenance (644271), Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Shared Task Representation for Human–Robot Collaborative Navigation: The Collaborative Search Case

  • Dalmasso, Marc
  • Domínguez Vidal, José Enrique
  • Torres-Rodríguez, Iván J.
  • Jiménez, Pablo
  • Garrell, Anaís
  • Sanfeliu, Alberto
Recent research in Human Robot Collaboration (HRC) has spread and specialised in many sub-fields. Many show considerable advances, but the human–robot collaborative navigation (HRCN) field seems to be stuck focusing on implicit collaboration settings, on hypothetical or simulated task allocation problems, on shared autonomy or on having the human as a manager. This work takes a step forward by presenting an end-to-end system capable of handling real-world human–robot collaborative navigation tasks. This system makes use of the Social Reward Sources model (SRS), a knowledge representation to simultaneously tackle task allocation and path planning, proposes a multi-agent Monte Carlo Tree Search (MCTS) planner for human–robot teams, presents the collaborative search as a testbed for HRCN and studies the usage of smartphones for communication in this setting. The detailed experiments prove the viability of the approach, explore collaboration roles adopted by the human–robot team and test the acceptability and utility of different communication interface designs., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656) and ROCOTRANSP project (PID2019- 106702RB-C21 / AEI / 10.13039/501100011033), the European research grant TERRINet (H2020-INFRAIA-2017-1-730994) and by JST Moonshot R & D Grant Number JPMJMS2011-85., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Adaptive Social Planner to Accompany People in Real-Life Dynamic Environments

  • Repiso, Ely
  • Garrell, Anaís
  • Sanfeliu, Alberto
Robots must develop the ability to socially navigate in uncontrolled urban environments to be able to be included in our daily lives. This paper presents a new robot navigation framework called the adaptive social planner (ASP) and a robotic system, which includes the ASP. Our results and previous work show that the ASP can adapt to different collaborative tasks involving humans and robots, such as independent robot navigation, human-robot accompaniment, a robot approaching people, robot navigation tasks that combine learning techniques, and human-drone interactions. Our approach in this paper focuses on demonstrating how the ASP can be customized to implement two new methods for group accompaniment: the adaptive social planner using a V-formation model to accompany groups of people (ASP-VG) and the adaptive social planner using a side-by-side model to accompany groups of people (ASP-SG). These two methods result in a robot accompanying groups of people by anticipating human and uncontrolled urban environment behaviors. Also, we develop four new robot skills to deal with unexpected human behaviors, such as rearrangement of the position of the companions inside the group, unforeseen changes in the velocity of the robot companions, occlusions among group members, and changes in the direction toward destinations in the environment. Moreover, we develop different performance metrics, based on social distances, to evaluate the tasks of the robot. In addition, we present the guidelines followed in performing the real-life experiments with volunteers, including a human-robot speech interaction to help humans create a relationship with the robot to be genuinely involved in the mutual accompaniment. Finally, we include an exhaustive validation of the methods by evaluating the behavior of the robot through synthetic and real-life experiments. We incorporate five user studies to evaluate aspects related to social acceptability and preferences of people regarding both types of robot group accompaniment., ROCOTRANSP: National Project. Funder: Ministerio de Ciencia e Innovacion (MCIN) y Agencia Española de Investigacion (AEI). Award Number: PID2019-106702RB-C21 MCIN / AEI/10.13039/501100011033. Grant Recipient: Alberto Sanfeliu Cortés (UPC). TERRINET: European Project. Funder: European Commission. Award Number: H2020-INFRAIA-2017-1-two-stage-730994. Grant Recipient: Alberto Sanfeliu Cortés (UPC)., Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

People's adaptive side-by-side model evolved to accompany groups of people by social robots

  • Repiso Polo, Ely|||0000-0001-6540-8347
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The presented method implements a robot accompaniment in an adaptive side-by-side formation of a single person or a group of people. The method enhances our previous robot adaptive side-by-side behavior allowing the robot to accompany a group of people, not only one person. Adaptive means that the robot is capable to adjust its position and velocity to the behavior of the group being accompanied, without bothering other pedestrians in the environment, as well as facilitating the group navigation to avoid static and dynamic obstacles. Furthermore, the robot can deal with the random factor of human behavior in several situations. Firstly, if other people interfere in the path of the companions, the robot leaves space for the person of the group that has to avoid those other people, by approaching the other companion. Also, without invading any personal space. Secondly, if the people of the group changes their physical position inside the group formation, then the robot adapts to them dynamically by changing from the lateral position to the central position of the formation or otherwise. Thirdly, the robot adapts to changes in the velocity of people in the group and other people that interfere in the path of the group, in magnitude and orientation. Fourthly, the robot can deal with occlusions of one accompanied person by the other. The method has been validated using synthetic experiments and real-life experiments with our robot. Finally, we developed an user study comparing the method with a Wizard of Oz., This work was supported in part by the Spanish Ministry of Science and Innovationunder Project ColRobTransp (DPI2016-78957-RAEI/FEDER EU), TERRINet(H2020-INFRAIA-2017-1-two-stage-730994) and in part by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI(MDM-2016-0656). Ely Repiso is also supported by the Spanish Ministry ofScience and Innovation under a FPI-grant, BES-2014-067713., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Event-based line SLAM in real-time

  • Chamorro Hernández, William Oswaldo
  • Solà Ortega, Joan|||0000-0002-2933-3381
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, Event-based cameras generate asynchronous streams of events, triggered proportionally to the logarithmic change of brightness in the scene. These cameras have very low latency and high dynamic range suitable to address challenging motion scenarios in robotics. In this work, we explore a new event-based line-SLAM approach following a parallel tracking and mapping philosophy. Our fast tracking algorithm, produces accurate camera pose estimates at a high rate by minimizing the event-line reprojection error with an error-state Kalman filter formulated entirely with Lie theory. The mapping thread leverages the natural edge highlighting strength of events to recover and optimize straight lines in human-made scenarios. The proper manipulation of matrix sparsity as well as the information sharing between tracking and mapping nodes allow us to achieve real-time performance on a standard multi-core CPU. This system was tested on several scenarios rich in straight edge objects, and compared against, ground truth and frame and event based state-of-the-art approaches., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Shared task representation for human–robot collaborative navigation: the collaborative search case

  • Dalmasso Blanch, Marc|||0000-0003-1734-7863
  • Domínguez Vidal, José Enrique|||0000-0002-0397-9248
  • Torres Rodriguez, Ivan Jesús
  • Jiménez Schlegl, Pablo|||0000-0003-3627-4938
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© The Author(s) 2023, Recent research in Human Robot Collaboration (HRC) has spread and specialised in many sub-fields. Many show considerable advances, but the human–robot collaborative navigation (HRCN) field seems to be stuck focusing on implicit collaboration settings, on hypothetical or simulated task allocation problems, on shared autonomy or on having the human as a manager. This work takes a step forward by presenting an end-to-end system capable of handling real-world human–robot collaborative navigation tasks. This system makes use of the Social Reward Sources model (SRS), a knowledge representation to simultaneously tackle task allocation and path planning, proposes a multi-agent Monte Carlo Tree Search (MCTS) planner for human–robot teams, presents the collaborative search as a testbed for HRCN and studies the usage of smartphones for communication in this setting. The detailed experiments prove the viability of the approach, explore collaboration roles adopted by the human–robot team and test the acceptability and utility of different communication interface designs., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656) and ROCOTRANSP project (PID2019- 106702RB-C21 / AEI / 10.13039/501100011033), the European research grant TERRINet (H2020-INFRAIA-2017-1-730994) and by JST Moonshot R & D Grant Number JPMJMS2011-85., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative multi-agent path planning using Monte Carlo tree search and social reward sources

  • Dalmasso Blanch, Marc|||0000-0003-1734-7863
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Domínguez Vidal, José Enrique|||0000-0002-0397-9248
  • Jiménez Schlegl, Pablo|||0000-0003-3627-4938
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, The collaboration between humans and robots in an object search task requires the achievement of shared plans obtained from communicating and negotiating. In this work, we assume that the robot computes, as a first step, a multiagent plan for both itself and the human. Then, both plans are submitted to human scrutiny, who either agrees or modifies it forcing the robot to adapt its own restrictions or preferences. This process is repeated along the search task as many times as required by the human. Our planner is based on a decentralized variant of Monte Carlo Tree Search (MCTS), with one robot and one human as agents. Moreover, our algorithm allows the robot and the human to optimize their own actions by maintaining a probability distribution over the plans in a joint action space. The method allows an objective function definition over action sequences, it assumes intermittent communication, it is anytime and suitable for on-line replanning. To test it, we have developed a human-robot communication mobile phone interface. Validation is provided by real-life search experiments of a Parcheesi token in an urban space, including also an acceptability study., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033), TERRINet (H2020-INFRAIA-2017-1-two-stage730994) and AI4EU (H2020-ICT-2018-2-825619), Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Adaptive side-by-side social robot navigation to approach and interact with people

  • Repiso Polo, Ely|||0000-0001-6540-8347
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
The final publication is available at link.springer.com, This paper presents a new framework for how autonomous social robots approach and accompany people in urban environments. The method discussed allows the robot to accompany a person and approach to other one, by adapting its own navigation in anticipation of future interactions with other people or contact with static obstacles. The contributions of the paper are manifold: firstly, we extended the Social Force model and the Anticipative Kinodynamic Planner to the case of an adaptive side-by-side navigation; secondly, we enhance side-by-side navigation with an approaching task and a final positioning that allows the robot to interact with both people; and finally, we use findings from experiments of real-life observations of people walking in pairs to define the parameters of the human-robot interaction in our case of adaptive side-by-side. The method was validated by a large set of simulations; we also conducted real-life experiments with our robot, Tibi, to validate the framework described for the interaction process. In addition, we carried out various surveys and user studies to indicate the social acceptability of the robot’s performance of the accompanying, approaching and positioning tasks., Work supported by the Spanish Ministry of Science and Innovationunder project ColRobTransp (DPI2016-78957-R. AEI/FEDER EU),by the Spanish State Research Agency through the Maria de MaeztuSeal of Excellence to IRI (MDM-2016-0656) and EU TERRINETproject (H2020-INFRAIA-2017-1-two-stage-730994). Ely Repiso isalso supported by Spanish Ministry of Science and Innovation under aFPI-grant (BES-2014-067713), Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative navigation search using social reward sources

  • Dalmasso Blanch, Marc|||0000-0003-1734-7863
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Jiménez Schlegl, Pablo|||0000-0003-3627-4938
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
The final publication is available at link.springer.com, This paper proposes a Social Reward Sources (SRS) design for a Human-Robot Collaborative Navigation (HRCN) task: human-robot collaborative search. It is a flexible approach capable of handling the collaborative task, human-robot interaction and environment restrictions, all integrated on a common environment. We modelled task rewards based on unexplored area observability and isolation and evaluated the model through different levels of human-robot communication.The models are validated through quantitative evaluation against both agents’ individual performance and qualitative surveying of participants’ perception. After that, the three proposed communication levels are com-pared against each other using the previous metrics., Work supported under projects ColRobTransp (DPI2016-78957-RAEI/FEDER EU), TERRINet (H2020-INFRAIA-2017-1-two-stage-730994) and by the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

C-Flow: conditional generative flow models for images and 3D point clouds

  • Pumarola Peris, Albert|||0000-0003-4185-6991
  • Popov, Stefan
  • Moreno-Noguer, Francesc
  • Ferrari, Vittorio
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, Flow-based generative models have highly desirable properties like exact log-likelihood evaluation and exact latent-variable inference, however they are still in their infancy and have not received as much attention as alternative generative models. In this paper, we introduce C-Flow, a novel conditioning scheme that brings normalizing flows to an entirely new scenario with great possibilities for multi-modal data modeling. C-Flow is based on a parallel sequence of invertible mappings in which a source flow guides the target flow at every step, enabling fine-grained control over the generation process. We also devise a new strategy to model unordered 3D point clouds that, in combination with the conditioning scheme, makes it possible to address 3D reconstruction from a single image and its inverse problem of rendering an image given a point cloud. We demonstrate our conditioning method to be very adaptable, being also applicable to image manipulation, style transfer and multi-modal image-to-image mapping in a diversity of domains, including RGB images, segmentation maps, and edge masks., This project was done during an internship at Google. It is also partially supported by the EU project TER-RINET: The European robotics research infrastructure network H2020-INFRAIA-2017-1-730994, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Adaptive social planner to accompany people in real-life dynamic environments

  • Repiso Polo, Ely|||0000-0001-6540-8347
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
Robots must develop the ability to socially navigate in uncontrolled urban environments to be able to be included in our daily lives. This paper presents a new robot navigation framework called the adaptive social planner (ASP) and a robotic system, which includes the ASP. Our results and previous work show that the ASP can adapt to different collaborative tasks involving humans and robots, such as independent robot navigation, human-robot accompaniment, a robot approaching people, robot navigation tasks that combine learning techniques, and human-drone interactions. Our approach in this paper focuses on demonstrating how the ASP can be customized to implement two new methods for group accompaniment: the adaptive social planner using a V-formation model to accompany groups of people (ASP-VG) and the adaptive social planner using a side-by-side model to accompany groups of people (ASP-SG). These two methods result in a robot accompanying groups of people by anticipating human and uncontrolled urban environment behaviors. Also, we develop four new robot skills to deal with unexpected human behaviors, such as rearrangement of the position of the companions inside the group, unforeseen changes in the velocity of the robot companions, occlusions among group members, and changes in the direction toward destinations in the environment. Moreover, we develop different performance metrics, based on social distances, to evaluate the tasks of the robot. In addition, we present the guidelines followed in performing the real-life experiments with volunteers, including a human-robot speech interaction to help humans create a relationship with the robot to be genuinely involved in the mutual accompaniment. Finally, we include an exhaustive validation of the methods by evaluating the behavior of the robot through synthetic and real-life experiments. We incorporate five user studies to evaluate aspects related to social acceptability and preferences of people regarding both types of robot group accompaniment., ROCOTRANSP: National Project. Funder: Ministerio de Ciencia e Innovacion (MCIN) y Agencia Española de Investigacion (AEI). Award Number: PID2019-106702RB-C21 MCIN / AEI/10.13039/501100011033. Grant Recipient: Alberto Sanfeliu Cortés (UPC). TERRINET: European Project. Funder: European Commission. Award Number: H2020-INFRAIA-2017-1-two-stage-730994. Grant Recipient: Alberto Sanfeliu Cortés (UPC)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Adaptive social planner to accompany people in real-life dynamic environments

  • Repiso Polo, Ely
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
Robots must develop the ability to socially navigate in uncontrolled urban environments to be able to be included in our daily lives. This paper presents a new robot navigation framework called the adaptive social planner (ASP) and a robotic system, which includes the ASP. Our results and previous work show that the ASP can adapt to different collaborative tasks involving humans and robots, such as independent robot navigation, human-robot accompaniment, a robot approaching people, robot navigation tasks that combine learning techniques, and human-drone interactions. Our approach in this paper focuses on demonstrating how the ASP can be customized to implement two new methods for group accompaniment: the adaptive social planner using a V-formation model to accompany groups of people (ASP-VG) and the adaptive social planner using a side-by-side model to accompany groups of people (ASP-SG). These two methods result in a robot accompanying groups of people by anticipating human and uncontrolled urban environment behaviors. Also, we develop four new robot skills to deal with unexpected human behaviors, such as rearrangement of the position of the companions inside the group, unforeseen changes in the velocity of the robot companions, occlusions among group members, and changes in the direction toward destinations in the environment. Moreover, we develop different performance metrics, based on social distances, to evaluate the tasks of the robot. In addition, we present the guidelines followed in performing the real-life experiments with volunteers, including a human-robot speech interaction to help humans create a relationship with the robot to be genuinely involved in the mutual accompaniment. Finally, we include an exhaustive validation of the methods by evaluating the behavior of the robot through synthetic and real-life experiments. We incorporate five user studies to evaluate aspects related to social acceptability and preferences of people regarding both types of robot group accompaniment., ROCOTRANSP: National Project. Funder: Ministerio de Ciencia e Innovacion (MCIN) y Agencia Española de Investigacion (AEI). Award Number: PID2019-106702RB-C21 MCIN / AEI/10.13039/501100011033. Grant Recipient: Alberto Sanfeliu Cortés (UPC). TERRINET: European Project. Funder: European Commission. Award Number: H2020-INFRAIA-2017-1-two-stage-730994. Grant Recipient: Alberto Sanfeliu Cortés (UPC)., Peer Reviewed, Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative multi-agent path planning using Monte Carlo tree search and social reward sources

  • Dalmasso Blanch, Marc
  • Garrell Zulueta, Anais
  • Domínguez Vidal, José Enrique
  • Jiménez Schlegl, Pablo
  • Sanfeliu Cortés, Alberto
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, The collaboration between humans and robots in an object search task requires the achievement of shared plans obtained from communicating and negotiating. In this work, we assume that the robot computes, as a first step, a multiagent plan for both itself and the human. Then, both plans are submitted to human scrutiny, who either agrees or modifies it forcing the robot to adapt its own restrictions or preferences. This process is repeated along the search task as many times as required by the human. Our planner is based on a decentralized variant of Monte Carlo Tree Search (MCTS), with one robot and one human as agents. Moreover, our algorithm allows the robot and the human to optimize their own actions by maintaining a probability distribution over the plans in a joint action space. The method allows an objective function definition over action sequences, it assumes intermittent communication, it is anytime and suitable for on-line replanning. To test it, we have developed a human-robot communication mobile phone interface. Validation is provided by real-life search experiments of a Parcheesi token in an urban space, including also an acceptability study., Work supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016- 0656), ROCOTRANSP project (PID2019-106702RB-C21 / AEI / 10.13039/501100011033), TERRINet (H2020-INFRAIA-2017-1-two-stage730994) and AI4EU (H2020-ICT-2018-2-825619), Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Adaptive side-by-side social robot navigation to approach and interact with people

  • Repiso Polo, Ely
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
The final publication is available at link.springer.com, This paper presents a new framework for how autonomous social robots approach and accompany people in urban environments. The method discussed allows the robot to accompany a person and approach to other one, by adapting its own navigation in anticipation of future interactions with other people or contact with static obstacles. The contributions of the paper are manifold: firstly, we extended the Social Force model and the Anticipative Kinodynamic Planner to the case of an adaptive side-by-side navigation; secondly, we enhance side-by-side navigation with an approaching task and a final positioning that allows the robot to interact with both people; and finally, we use findings from experiments of real-life observations of people walking in pairs to define the parameters of the human-robot interaction in our case of adaptive side-by-side. The method was validated by a large set of simulations; we also conducted real-life experiments with our robot, Tibi, to validate the framework described for the interaction process. In addition, we carried out various surveys and user studies to indicate the social acceptability of the robot’s performance of the accompanying, approaching and positioning tasks., Work supported by the Spanish Ministry of Science and Innovationunder project ColRobTransp (DPI2016-78957-R. AEI/FEDER EU),by the Spanish State Research Agency through the Maria de MaeztuSeal of Excellence to IRI (MDM-2016-0656) and EU TERRINETproject (H2020-INFRAIA-2017-1-two-stage-730994). Ely Repiso isalso supported by Spanish Ministry of Science and Innovation under aFPI-grant (BES-2014-067713), Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

People's adaptive side-by-side model evolved to accompany groups of people by social robots

  • Repiso Polo, Ely
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The presented method implements a robot accompaniment in an adaptive side-by-side formation of a single person or a group of people. The method enhances our previous robot adaptive side-by-side behavior allowing the robot to accompany a group of people, not only one person. Adaptive means that the robot is capable to adjust its position and velocity to the behavior of the group being accompanied, without bothering other pedestrians in the environment, as well as facilitating the group navigation to avoid static and dynamic obstacles. Furthermore, the robot can deal with the random factor of human behavior in several situations. Firstly, if other people interfere in the path of the companions, the robot leaves space for the person of the group that has to avoid those other people, by approaching the other companion. Also, without invading any personal space. Secondly, if the people of the group changes their physical position inside the group formation, then the robot adapts to them dynamically by changing from the lateral position to the central position of the formation or otherwise. Thirdly, the robot adapts to changes in the velocity of people in the group and other people that interfere in the path of the group, in magnitude and orientation. Fourthly, the robot can deal with occlusions of one accompanied person by the other. The method has been validated using synthetic experiments and real-life experiments with our robot. Finally, we developed an user study comparing the method with a Wizard of Oz., This work was supported in part by the Spanish Ministry of Science and Innovationunder Project ColRobTransp (DPI2016-78957-RAEI/FEDER EU), TERRINet(H2020-INFRAIA-2017-1-two-stage-730994) and in part by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI(MDM-2016-0656). Ely Repiso is also supported by the Spanish Ministry ofScience and Innovation under a FPI-grant, BES-2014-067713., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Shared task representation for human–robot collaborative navigation: the collaborative search case

  • Dalmasso Blanch, Marc
  • Domínguez Vidal, José Enrique
  • Torres Rodriguez, Ivan Jesús
  • Jiménez Schlegl, Pablo
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
© The Author(s) 2023, Recent research in Human Robot Collaboration (HRC) has spread and specialised in many sub-fields. Many show considerable advances, but the human–robot collaborative navigation (HRCN) field seems to be stuck focusing on implicit collaboration settings, on hypothetical or simulated task allocation problems, on shared autonomy or on having the human as a manager. This work takes a step forward by presenting an end-to-end system capable of handling real-world human–robot collaborative navigation tasks. This system makes use of the Social Reward Sources model (SRS), a knowledge representation to simultaneously tackle task allocation and path planning, proposes a multi-agent Monte Carlo Tree Search (MCTS) planner for human–robot teams, presents the collaborative search as a testbed for HRCN and studies the usage of smartphones for communication in this setting. The detailed experiments prove the viability of the approach, explore collaboration roles adopted by the human–robot team and test the acceptability and utility of different communication interface designs., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported under the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656) and ROCOTRANSP project (PID2019- 106702RB-C21 / AEI / 10.13039/501100011033), the European research grant TERRINet (H2020-INFRAIA-2017-1-730994) and by JST Moonshot R & D Grant Number JPMJMS2011-85., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Event-based line SLAM in real-time

  • Chamorro Hernández, William Oswaldo
  • Solà Ortega, Joan
  • Andrade-Cetto, Juan
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, Event-based cameras generate asynchronous streams of events, triggered proportionally to the logarithmic change of brightness in the scene. These cameras have very low latency and high dynamic range suitable to address challenging motion scenarios in robotics. In this work, we explore a new event-based line-SLAM approach following a parallel tracking and mapping philosophy. Our fast tracking algorithm, produces accurate camera pose estimates at a high rate by minimizing the event-line reprojection error with an error-state Kalman filter formulated entirely with Lie theory. The mapping thread leverages the natural edge highlighting strength of events to recover and optimize straight lines in human-made scenarios. The proper manipulation of matrix sparsity as well as the information sharing between tracking and mapping nodes allow us to achieve real-time performance on a standard multi-core CPU. This system was tested on several scenarios rich in straight edge objects, and compared against, ground truth and frame and event based state-of-the-art approaches., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

C-Flow: conditional generative flow models for images and 3D point clouds

  • Pumarola Peris, Albert
  • Popov, Stefan
  • Moreno-Noguer, Francesc
  • Ferrari, Vittorio
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, Flow-based generative models have highly desirable properties like exact log-likelihood evaluation and exact latent-variable inference, however they are still in their infancy and have not received as much attention as alternative generative models. In this paper, we introduce C-Flow, a novel conditioning scheme that brings normalizing flows to an entirely new scenario with great possibilities for multi-modal data modeling. C-Flow is based on a parallel sequence of invertible mappings in which a source flow guides the target flow at every step, enabling fine-grained control over the generation process. We also devise a new strategy to model unordered 3D point clouds that, in combination with the conditioning scheme, makes it possible to address 3D reconstruction from a single image and its inverse problem of rendering an image given a point cloud. We demonstrate our conditioning method to be very adaptable, being also applicable to image manipulation, style transfer and multi-modal image-to-image mapping in a diversity of domains, including RGB images, segmentation maps, and edge masks., This project was done during an internship at Google. It is also partially supported by the EU project TER-RINET: The European robotics research infrastructure network H2020-INFRAIA-2017-1-730994, Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Human-robot collaborative navigation search using social reward sources

  • Dalmasso Blanch, Marc
  • Garrell Zulueta, Anais
  • Jiménez Schlegl, Pablo
  • Sanfeliu Cortés, Alberto
The final publication is available at link.springer.com, This paper proposes a Social Reward Sources (SRS) design for a Human-Robot Collaborative Navigation (HRCN) task: human-robot collaborative search. It is a flexible approach capable of handling the collaborative task, human-robot interaction and environment restrictions, all integrated on a common environment. We modelled task rewards based on unexplored area observability and isolation and evaluated the model through different levels of human-robot communication.The models are validated through quantitative evaluation against both agents’ individual performance and qualitative surveying of participants’ perception. After that, the three proposed communication levels are com-pared against each other using the previous metrics., Work supported under projects ColRobTransp (DPI2016-78957-RAEI/FEDER EU), TERRINet (H2020-INFRAIA-2017-1-two-stage-730994) and by the Spanish State Research Agency through the Maria de Maeztu Seal of Excellence to IRI (MDM-2016-0656)., Peer Reviewed, Postprint (author's final draft)