Pasar al contenido principal

COLLABORATIVE HIERARCHICAL ROBOTIC EXPLANATIONS

PCI2020-120718-2

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos Programación Conjunta Internacional
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 11
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

“I know how you feel” The importance of interaction style on users’ acceptance in an entertainment scenario

  • Andriella, Antonio
  • Huertas García, Rubén
  • Forgas Coll, Santiago
  • Torras, Carme
  • Alenyà, Guillem
In this article, we aim to evaluate the role of robots’ personality-driven behavioural patterns on users’ intention to use in an entertainment scenario. Toward such a goal, we designed two personalities: one introverted with an empathic and self-comparative interaction style, and the other extroverted with a provocative and other-comparative interaction style. To evaluate the proposed technology acceptance model, we conducted an experiment (N=209) at a public venue where users were requested to play a game with the support of the TIAGo robot. Our findings show that the robot personality affects the acceptance model and three relevant drivers: perceived enjoyment, perceived usefulness, and social influence. The extroverted robot was perceived as more useful than the introverted, and participants who interacted with it were faster at solving the game. On the other hand, the introverted robot was perceived as more enjoyable but less useful than the extroverted, and participants who interacted with it made fewer mistakes. Taken together, these findings support the importance of designing proper robot personalities in influencing users’ acceptance, featuring that a given style can elicit a different driver of acceptance., *This work has been partially funded by the European Union's Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGen- erationEU/PRTR under the project ROB-IN (PLEC2021-007859) and the project COHERENT (PCI2020- 120718-2); and by the European Commission{ NextGenerationEU, through CSIC's Thematic Platforms (PTI+ Neuro-Aging).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

OCRA – An ontology for collaborative robotics and adaptation

  • Olivares-Alarcos, Alberto
  • Foix, Sergi
  • Borgo, Stefano
  • Alenyà, Guillem
Industrial collaborative robots will be used in unstructured scenarios and a large variety of tasks in the near future. These robots shall collaborate with humans, who will add uncertainty and safety constraints to the execution of industrial robotic tasks. Hence, trustworthy collaborative robots must be able to reason about their collaboration's requirements (e.g., safety), as well as the adaptation of their plans due to unexpected situations. A common approach to reasoning is to represent the knowledge of interest using logic-based formalisms, such as ontologies. However, there is not an established ontology defining notions such as collaboration or adaptation yet. In this article, we propose an Ontology for Collaborative Robotics and Adaptation (OCRA), which is built around two main notions: collaboration, and plan adaptation. OCRA ensures a reliable human-robot collaboration, since robots can formalize, and reason about their plan adaptations and collaborations in unstructured collaborative robotic scenarios. Furthermore, our ontology enhances the reusability of the domain's terminology, allowing robots to represent their knowledge about different collaborative and adaptive situations. We validate our formal model, first, by demonstrating that a robot may answer a set of competency questions using OCRA. Second, by studying the formalization's performance in limit cases that include instances with incongruent and incomplete axioms. For both validations, the example use case consists in a human and a robot collaborating on the filling of a tray., This work has been partially funded by MCIN/ AEI /10.13039/501100011033, Spain, under the project CHLOE-GRAPH (PID2020-119244GB-I00); by MCIN/ AEI /10.13039/501100011033, Spain, and by the “European Union NextGenerationEU/PRTR, Spain, under the project COHERENT (PCI2020-120718-2); and by the European Commission- NextGenerationEU, through CSIC’s Thematic Platforms (PTI+ Neuro-Aging), Spain. S. Borgo is partially supported by the European project OntoCommons (GA 958371), Italy. A. Olivares-Alarcos is supported by the European Social Fund and the Ministry of Business and Knowledge of Catalonia, Spain, through the FI 2020 grant.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Improved Task Planning through Failure Anticipation in Human-Robot Collaboration

  • Izquierdo Badiola, Silvia
  • Canal, Gerard
  • Rizzo, Carlos
  • Alenyà, Guillem
Trabajo presentado en la International Conference on Robotics and Automation (ICRA), celebrada en Philadelphia (Estados Unidos), del 23 al 27 de mayo de 2022, Human-Robot Collaboration (HRC) has become a major trend in robotics in recent years with the idea of combining the strengths from both humans and robots. In order to share the work to be done, many task planning approaches have been implemented. However, they don't fully satisfy the required adaptability in human-robot collaborative tasks, with most approaches not considering neither the state of the human partner nor the possibility of adapting the collaborative plan during execution or even anticipating failures. In this paper, we present a planning system for human-robot collaborative plans that takes into account the agents' states and deals with unforeseen human behaviour, by replanning in anticipation when the human state changes to prevent action failure. The human state is defined in terms of capacity, knowledge and motivation. The system has been implemented in a standardised environment using the Planning Domain Definition Language (PDDL) and the modular ROSPlan framework, and we have validated the approach in multiple simulation settings. Our results show that using the human model fosters an appropriate task allocation while allowing failure anticipation, replanning in time to prevent it., This work was financially supported by the Catalan Government through the funding grant ACCIO-Eurecat, and partially supported by MCIN/ AEI ´ /10.13039/501100011033 under the project CHLOE-GRAPH (PID2020- 118649RB-l00); by MCIN/ AEI /10.13039/501100011033 and by the European Union NextGenerationEU/PRTR under the project COHERENT (PCI2020-120718-2). Gerard Canal has been partially supported by EPSRC grant THuMP (EP/R033722/1) and by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Does the Personality of Consumers Influence the Assessment of the Experience of Interaction with Social Robots?

  • Forgas Coll, Santiago
  • Huertas García, Rubén
  • Andriella, Antonio
  • Alenyà, Guillem
In recent years, in response to the effects of Covid-19, there has been an increase in the use of social robots in service organisations, as well as in the number of interactions between consumers and robots. However, it is not clear how consumers are valuing these experiences or what the main drivers that shape them are. Furthermore, it is an open research question whether these experiences undergone by consumers can be affected by their own personality. This study attempts to shed some light on these questions and, to do so, an experiment is proposed in which a sample of 378 participants evaluate a simulated front-office service experience delivered by a social robot. The authors investigate the underlying process that explains the experience and find that cognitive-functional factors, emphasising efficiency, have practically the same relevance as emotional factors, emphasising stimulation. In addition, this research identifies the personality traits of the participants and explores their moderating role in the evaluation of the experience. The results reveal that each personality trait, estimated between high and low poles, generates different responses in the evaluation of the experience., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially funded by the European Union's Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI/10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR" under the project ROB-IN (PLEC2021-007859) and the project COHERENT (PCI2020-120718-2); and by the "European Union NextGenerationEU/PRTR" through CSIC's Thematic Platforms (PTI + Neuro-Aging)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Introducing CARESSER: A framework for in situ learning robot social assistance from expert knowledge and demonstrations

  • Andriella, Antonio
  • Torras, Carme
  • Abdelnour, Carla
  • Alenyà, Guillem
Socially assistive robots have the potential to augment and enhance therapist’s effectiveness in repetitive tasks such as cognitive therapies. However, their contribution has generally been limited as domain experts have not been fully involved in the entire pipeline of the design process as well as in the automatisation of the robots’ behaviour. In this article, we present aCtive leARning agEnt aSsiStive bEhaviouR (CARESSER), a novel framework that actively learns robotic assistive behaviour by leveraging the therapist’s expertise (knowledge-driven approach) and their demonstrations (data-driven approach). By exploiting that hybrid approach, the presented method enables in situ fast learning, in a fully autonomous fashion, of personalised patient-specific policies. With the purpose of evaluating our framework, we conducted two user studies in a daily care centre in which older adults affected by mild dementia and mild cognitive impairment (N = 22) were requested to solve cognitive exercises with the support of a therapist and later on of a robot endowed with CARESSER. Results showed that: (i) the robot managed to keep the patients’ performance stable during the sessions even more so than the therapist; (ii) the assistance offered by the robot during the sessions eventually matched the therapist’s preferences. We conclude that CARESSER, with its stakeholder-centric design, can pave the way to new AI approaches that learn by leveraging human–human interactions along with human expertise, which has the benefits of speeding up the learning process, eliminating the need for the design of complex reward functions, and finally avoiding undesired states., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially funded by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI /10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR” under the project ROB-IN (PLEC2021-007859) and the project COHERENT (PCI2020-120718-2); and by the “European Union NextGenerationEU/PRTR”, through CSIC’s Thematic Platforms (PTI+ Neuro-Aging).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Virtual Reality Framework For Fast Dataset Creation Applied to Cloth Manipulation with Automatic Semantic Labelling

  • Borràs, Julia
  • Boix-Granell, Arnau
  • Foix, Sergi
  • Torras, Carme
Trabajo presentado en la IEEE International Conference on Robotics and Automation (ICRA), celebrada en Londres (UK), del 29 de mayo al 2 de junio de 2024, Teaching complex manipulation skills, such as folding garments, to a bi-manual robot is a very challenging task, which is often tackled through learning from demon-stration. The few datasets of garment-folding demonstrations available nowadays to the robotics research community have been either gathered from human demonstrations or generated through simulation. The former have the great difficulty of perceiving both cloth state and human action as well as transferring them to the dynamic control of the robot, while the latter require coding human motion into the simulator in open loop, i.e., without incorporating the visual feedback naturally used by people, resulting in far-from-realistic movements. In this article, we present an accurate dataset of human cloth folding demonstrations. The dataset is collected through our novel virtual reality (VR) framework, based on Unity's 3D platform and the use of an HTC Vive Pro system. The framework is capable of simulating realistic garments while allowing users to interact with them in real time through handheld controllers. By doing so, and thanks to the immersive experience, our framework permits exploiting human visual feedback in the demonstrations while at the same time getting rid of the difficulties of capturing the state of cloth, thus simplifying data acquisition and resulting in more realistic demonstrations. We create and make public a dataset of cloth manipulation sequences, whose cloth states are semantically labeled in an automatic way by using a novel low-dimensional cloth representation that yields a very good separation between different cloth configurations., The research leading to these results receives funding from the European Research Council (ERC) from the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE: CLOTH manIpulation Learning from DEmonstrations) and project SoftEnable (HORIZONCL4- 2021-DIGITAL-EMERGING-01-101070600). Authors also received funding from project CHLOE-GRAPH (PID2020-118649RB-I00) funded by MCIN/ AEI /10.13039/501100011033 and COHERENT (PCI2020-120718- 2) funded by MCIN/ AEI /10.13039/501100011033 and cofunded by the ”European Union NextGenerationEU/PRTR”., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Bayesian framework for learning proactive robot behaviour in assistive tasks

  • Andriella, Antonio
  • Cucciniello, Ilenia
  • Origlia, Antonio
  • Rossi, Silvia
Socially assistive robots represent a promising tool in assistive contexts for improving people’s quality of life and well-being through social, emotional, cognitive, and physical support. However, the effectiveness of interactions heavily relies on the robots’ ability to adapt to the needs of the assisted individuals and to offer support proactively, before it is explicitly requested. Previous work has primarily focused on defining the actions the robot should perform, rather than considering when to act and how confident it should be in a given situation. To address this gap, this paper introduces a new data-driven framework that involves a learning pipeline, consisting of two phases, with the ultimate goal of training an algorithm based on Influence Diagrams. The proposed assistance scenario involves a sequential memory game, where the robot autonomously learns what assistance to provide when to intervene, and with what confidence to take control. The results from a user study showed that the proactive behaviour of the robot had a positive impact on the users’ game performance. Users obtained higher scores, made fewer mistakes, and requested less assistance from the robot. The study also highlighted the robot’s ability to provide assistance tailored to users’ specific needs and anticipate their requests., This work was partially funded by the Italian Ministry for Universities and Research (MUR) under the grant FIT4MEDROB (MUR: PNC0000007) (S. Rossi), by the Italian MUR and EU under the CHIST-ERA IV project COHERENT (PCI2020-120718-2) (I. Cucciniello), and by the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 801342 (Tecniospring INDUSTRY) and by the EU-founded project grant agreement No 101070930 (VALAWAI) (A. Andriella)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Ontological Modeling and Reasoning for Comparison and Contrastive Narration of Robot Plans

  • Olivares-Alarcos, Alberto
  • Foix, Sergi
  • Borràs, Julia
  • Canal, Gerard
  • Alenyà, Guillem
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., This work was partially supported by Project PID2020-118649RBI00 funded by MCIN/ AEI /10.13039/501100011033; Project PCI2020- 120718-2 funded by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR"; Project EP/V062506/1 funded by EPSRC (UK); and also by the European Union under the project ARISE (HORIZON-CL4-2023-DIGITAL-EMERGING-01- 101135959). G. Canal was supported by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme. A. Olivares-Alarcos was supported by the European Social Fund and the Ministry of Business and Knowledge of Catalonia through the FI 2020 grant., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

PlanCollabNL: Leveraging Large Language Models for Adaptive Plan Generation in Human-Robot Collaboration

  • Izquierdo-Badiola, Silvia
  • Canal, Gerard
  • Rizzo, Carlos
  • Alenyà, Guillem
"Hey, robot. Let's tidy up the kitchen. By the way, I have back pain today". How can a robotic system devise a shared plan with an appropriate task allocation from this abstract goal and agent condition? Classical AI task planning has been explored for this purpose, but it involves a tedious definition of an inflexible planning problem. Large Language Models (LLMs) have shown promising generalisation capabilities in robotics decision-making through knowledge extraction from Natural Language (NL). However, the translation of NL information into constrained robotics domains remains a challenge. In this paper, we use LLMs as translators between NL information and a structured AI task planning problem, targeting human-robot collaborative plans. The LLM generates information that is encoded in the planning problem, including specific subgoals derived from an NL abstract goal, as well as recommendations for subgoal allocation based on NL agent conditions. The framework, PlanCollabNL, is evaluated for a number of goals and agent conditions, and the results show that correct and executable plans are found in most cases. With this framework, we intend to add flexibility and generalisation to HRC plan generation, eliminating the need for a manual and laborious definition of restricted planning problems and agent models., This work was partially financed by MCIN/ AEI /10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR” under the project ROB-IN (PLEC2021-007859); and by the project COHERENT funded by MCIN/ AEI /10.13039/501100011033, Spain, the “European Union NextGenerationEU/ PRTR”, Spain, (PCI2020-120718-2), and by UKRI (EP/V062506/1)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Semantic State Estimation in Robot Cloth Manipulations Using Domain Adaptation from Human Demonstrations

  • Tzelepis, Georgies
  • Aksoy, Eren Erdal
  • Borràs, Julia
  • Alenyà, Guillem
Deformable object manipulations, such as those involving textiles, present a significant challenge due to their high dimensionality and complexity. In this paper, we propose a solution for estimating semantic states in cloth manipulation tasks. To this end, we introduce a new, large-scale, fully-annotated RGB image dataset of semantic states featuring a diverse range of human demonstrations of various complex cloth manipulations. This effectively transforms the problem of action recognition into a classification task. We then evaluate the generalizability of our approach by employing domain adaptation techniques to transfer knowledge from human demonstrations to two distinct robotic platforms: Kinova and UR robots. Additionally, we further improve performance by utilizing a semantic state graph learned from human manipulation data., This work has been partially funded by MCIN/ AEI /10.13039/ 501100011033, Spain, under the project CHLOE-GRAPH (PID2020- 119244GB-I00); by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); and by MCIN/ AEI /10.13039/501100011033, Spain, and by the “European Union NextGenerationEU/ PRTR, Spain, under the project COHERENT (PCI2020-120718-2);, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Standardization of Cloth Objects and its Relevance in Robotic Manipulation

  • García-Camacho, Irene
  • Longhini, Alberta
  • Welle, Michael
  • Alenyà, Guillem
  • Kragic, Danica
  • Borràs, Julia
The field of robotics faces inherent challenges in manipulating deformable objects, particularly in understanding and standardising fabric properties like elasticity, stiffness, and friction. While the significance of these properties is evident in the realm of cloth manipulation, accurately categorising and comprehending them in real-world applications remains elusive. This study sets out to address two primary objectives: (1) to provide a framework suitable for robotics applications to characterise cloth objects, and (2) to study how these properties influence robotic manipulation tasks. Our preliminary results validate the framework's ability to characterise cloth properties and compare cloth sets, and reveal the influence that different properties have on the outcome of five manipulation primitives. We believe that, in general, results on the manipulation of clothes should be reported along with a better description of the garments used in the evaluation. This paper proposes a set of these measures., This work has been supported by project PID2020-118649RB-I00 funded by MCIN/ AEI /10.13039/501100011033, by project PCI2020-120718-2 funded by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR”, by CSIC iMOVE 2023 grant (code 23254) and by the European Research Council (ERCBIRD), Swedish Research Council and Knut and Alice Wallenberg Foundation, the National Science Foundation under NSF CAREER grant number: IIS-2046491, Peer reviewed