Skip to main content

COLLABORATIVE HIERARCHICAL ROBOTIC EXPLANATIONS

PCI2020-120718-2

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos Programación Conjunta Internacional
Call year 2020
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 20
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

“I know how you feel” The importance of interaction style on users’ acceptance in an entertainment scenario

  • Andriella, Antonio
  • Huertas García, Rubén
  • Forgas Coll, Santiago
  • Torras, Carme
  • Alenyà, Guillem
In this article, we aim to evaluate the role of robots’ personality-driven behavioural patterns on users’ intention to use in an entertainment scenario. Toward such a goal, we designed two personalities: one introverted with an empathic and self-comparative interaction style, and the other extroverted with a provocative and other-comparative interaction style. To evaluate the proposed technology acceptance model, we conducted an experiment (N=209) at a public venue where users were requested to play a game with the support of the TIAGo robot. Our findings show that the robot personality affects the acceptance model and three relevant drivers: perceived enjoyment, perceived usefulness, and social influence. The extroverted robot was perceived as more useful than the introverted, and participants who interacted with it were faster at solving the game. On the other hand, the introverted robot was perceived as more enjoyable but less useful than the extroverted, and participants who interacted with it made fewer mistakes. Taken together, these findings support the importance of designing proper robot personalities in influencing users’ acceptance, featuring that a given style can elicit a different driver of acceptance., *This work has been partially funded by the European Union's Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGen- erationEU/PRTR under the project ROB-IN (PLEC2021-007859) and the project COHERENT (PCI2020- 120718-2); and by the European Commission{ NextGenerationEU, through CSIC's Thematic Platforms (PTI+ Neuro-Aging).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

OCRA – An ontology for collaborative robotics and adaptation

  • Olivares-Alarcos, Alberto
  • Foix, Sergi
  • Borgo, Stefano
  • Alenyà, Guillem
Industrial collaborative robots will be used in unstructured scenarios and a large variety of tasks in the near future. These robots shall collaborate with humans, who will add uncertainty and safety constraints to the execution of industrial robotic tasks. Hence, trustworthy collaborative robots must be able to reason about their collaboration's requirements (e.g., safety), as well as the adaptation of their plans due to unexpected situations. A common approach to reasoning is to represent the knowledge of interest using logic-based formalisms, such as ontologies. However, there is not an established ontology defining notions such as collaboration or adaptation yet. In this article, we propose an Ontology for Collaborative Robotics and Adaptation (OCRA), which is built around two main notions: collaboration, and plan adaptation. OCRA ensures a reliable human-robot collaboration, since robots can formalize, and reason about their plan adaptations and collaborations in unstructured collaborative robotic scenarios. Furthermore, our ontology enhances the reusability of the domain's terminology, allowing robots to represent their knowledge about different collaborative and adaptive situations. We validate our formal model, first, by demonstrating that a robot may answer a set of competency questions using OCRA. Second, by studying the formalization's performance in limit cases that include instances with incongruent and incomplete axioms. For both validations, the example use case consists in a human and a robot collaborating on the filling of a tray., This work has been partially funded by MCIN/ AEI /10.13039/501100011033, Spain, under the project CHLOE-GRAPH (PID2020-119244GB-I00); by MCIN/ AEI /10.13039/501100011033, Spain, and by the “European Union NextGenerationEU/PRTR, Spain, under the project COHERENT (PCI2020-120718-2); and by the European Commission- NextGenerationEU, through CSIC’s Thematic Platforms (PTI+ Neuro-Aging), Spain. S. Borgo is partially supported by the European project OntoCommons (GA 958371), Italy. A. Olivares-Alarcos is supported by the European Social Fund and the Ministry of Business and Knowledge of Catalonia, Spain, through the FI 2020 grant.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Knowledge representation to enable high-level planning in cloth manipulation tasks

  • García-Camacho, Irene
  • Borràs, Julia
  • Alenyà, Guillem
Trabajo presentado en la ICAPS Workshop on Knowledge Engineering for Planning and Scheduling, celebrada en Singapore, el 15 de junio de 2022, Cloth manipulation is very relevant for domestic robotic tasks, but it presents many challenges due to the complexity of representing, recognizing and predicting the behaviour of cloth under manipulation. In this work, we propose a generic, compact and simplified representation of the states of cloth manipulation that allows for representing tasks as sequences of states and transitions semantically. We also define a Cloth Manipulation Graph that encodes all the strategies to accomplish a task. Our novel representation is used to encode two different cloth manipulation tasks, learned from an experiment with human subjects manipulating clothes with video data. We show how our simplified representation allows to obtain a map of meaningful steps that can serve to describe cloth manipulation tasks as domain models in PDDL, enabling high-level planning. Finally, we discuss on the existing skills that could enable the sensory motor grounding and the low-level execution of the plan., The research leading to these results receives funding from the European Research Council (ERC) from the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE: CLOTH manIpulation Learning from DEmonstrations); by MCIN/ AEI /10.13039/501100011033, Spain, under the project CHLOE-GRAPH (PID2020-119244GB-I00); by MCIN/ AEI /10.13039/501100011033, Spain, and by the “European Union NextGenerationEU/PRTR, Spain, under the project COHERENT (PCI2020-120718-2); and by the European Commission- NextGenerationEU, through CSIC’s Thematic Platforms (PTI+ Neuro-Aging).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Improved Task Planning through Failure Anticipation in Human-Robot Collaboration

  • Izquierdo Badiola, Silvia
  • Canal, Gerard
  • Rizzo, Carlos
  • Alenyà, Guillem
Trabajo presentado en la International Conference on Robotics and Automation (ICRA), celebrada en Philadelphia (Estados Unidos), del 23 al 27 de mayo de 2022, Human-Robot Collaboration (HRC) has become a major trend in robotics in recent years with the idea of combining the strengths from both humans and robots. In order to share the work to be done, many task planning approaches have been implemented. However, they don't fully satisfy the required adaptability in human-robot collaborative tasks, with most approaches not considering neither the state of the human partner nor the possibility of adapting the collaborative plan during execution or even anticipating failures. In this paper, we present a planning system for human-robot collaborative plans that takes into account the agents' states and deals with unforeseen human behaviour, by replanning in anticipation when the human state changes to prevent action failure. The human state is defined in terms of capacity, knowledge and motivation. The system has been implemented in a standardised environment using the Planning Domain Definition Language (PDDL) and the modular ROSPlan framework, and we have validated the approach in multiple simulation settings. Our results show that using the human model fosters an appropriate task allocation while allowing failure anticipation, replanning in time to prevent it., This work was financially supported by the Catalan Government through the funding grant ACCIO-Eurecat, and partially supported by MCIN/ AEI ´ /10.13039/501100011033 under the project CHLOE-GRAPH (PID2020- 118649RB-l00); by MCIN/ AEI /10.13039/501100011033 and by the European Union NextGenerationEU/PRTR under the project COHERENT (PCI2020-120718-2). Gerard Canal has been partially supported by EPSRC grant THuMP (EP/R033722/1) and by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Does the Personality of Consumers Influence the Assessment of the Experience of Interaction with Social Robots?

  • Forgas Coll, Santiago
  • Huertas García, Rubén
  • Andriella, Antonio
  • Alenyà, Guillem
In recent years, in response to the effects of Covid-19, there has been an increase in the use of social robots in service organisations, as well as in the number of interactions between consumers and robots. However, it is not clear how consumers are valuing these experiences or what the main drivers that shape them are. Furthermore, it is an open research question whether these experiences undergone by consumers can be affected by their own personality. This study attempts to shed some light on these questions and, to do so, an experiment is proposed in which a sample of 378 participants evaluate a simulated front-office service experience delivered by a social robot. The authors investigate the underlying process that explains the experience and find that cognitive-functional factors, emphasising efficiency, have practically the same relevance as emotional factors, emphasising stimulation. In addition, this research identifies the personality traits of the participants and explores their moderating role in the evaluation of the experience. The results reveal that each personality trait, estimated between high and low poles, generates different responses in the evaluation of the experience., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially funded by the European Union's Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI/10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR" under the project ROB-IN (PLEC2021-007859) and the project COHERENT (PCI2020-120718-2); and by the "European Union NextGenerationEU/PRTR" through CSIC's Thematic Platforms (PTI + Neuro-Aging)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Introducing CARESSER: A framework for in situ learning robot social assistance from expert knowledge and demonstrations

  • Andriella, Antonio
  • Torras, Carme
  • Abdelnour, Carla
  • Alenyà, Guillem
Socially assistive robots have the potential to augment and enhance therapist’s effectiveness in repetitive tasks such as cognitive therapies. However, their contribution has generally been limited as domain experts have not been fully involved in the entire pipeline of the design process as well as in the automatisation of the robots’ behaviour. In this article, we present aCtive leARning agEnt aSsiStive bEhaviouR (CARESSER), a novel framework that actively learns robotic assistive behaviour by leveraging the therapist’s expertise (knowledge-driven approach) and their demonstrations (data-driven approach). By exploiting that hybrid approach, the presented method enables in situ fast learning, in a fully autonomous fashion, of personalised patient-specific policies. With the purpose of evaluating our framework, we conducted two user studies in a daily care centre in which older adults affected by mild dementia and mild cognitive impairment (N = 22) were requested to solve cognitive exercises with the support of a therapist and later on of a robot endowed with CARESSER. Results showed that: (i) the robot managed to keep the patients’ performance stable during the sessions even more so than the therapist; (ii) the assistance offered by the robot during the sessions eventually matched the therapist’s preferences. We conclude that CARESSER, with its stakeholder-centric design, can pave the way to new AI approaches that learn by leveraging human–human interactions along with human expertise, which has the benefits of speeding up the learning process, eliminating the need for the design of complex reward functions, and finally avoiding undesired states., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work has been partially funded by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI /10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR” under the project ROB-IN (PLEC2021-007859) and the project COHERENT (PCI2020-120718-2); and by the “European Union NextGenerationEU/PRTR”, through CSIC’s Thematic Platforms (PTI+ Neuro-Aging).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Time-to-contact for robot safety stop in close collaborative tasks

  • Olivares-Alarcos, Alberto
  • Foix, Sergi
  • Alenyà, Guillem
Within the next years, industrial collaborative robots will collaborate with human operators, whose safety might be compromised. To ensure a safe collaboration, robots should estimate the risk of collision with respect to the pose and motion of operators within the shared workspace. A common approach is to compute and maintain a minimum distance between humans and robots during tasks' execution. Nevertheless, separation-based solutions do not capture the real dynamics of the human-robot interaction and tend to be rather conservative, avoiding a close human-robot collaboration. In this chapter, we explore the concept of time-to-contact (TTC) as a softer trigger of safety stops in collaborative scenarios where humans and robots are in constant closeness. Particularly, we propose a TTC formulation and study its advantages with respect to two approaches based on the protective distance proposed by the ISO standards. We compared the three methods in some representative cases extracted from an example of a collaborative task. The evaluation is firstly done in simulation and then in a more realistic setup with a simulated human, aiming for repeatability, and a real robot. Furthermore, we showcased our approach in a demo of a complete collaborative task. TTC allows robots to operate closer to humans and for longer times before a safety stop is issued, which benefits long-term productivity. This later stop produces shorter human-robot distances, which might affect safety. However, the increment in time that the robot moves before stopping (productivity) is far greater than the reduction in the distance (safety). Hence, we can state that TTC greatly improves productivity while slightly compromising safety. In conclusion, our work demonstrates that TTC is a smoother, but still safe, collision risk estimator for close human-robot collaboration, This work has been partially funded by MCIN/ AEI /10.13039/501100011033 under the project CHLOE-GRAPH (PID2020-119244GB-I00); by the ”European Union (EU) NextGenerationEU/PRTR and by MCIN/ AEI /10.13039/501100011033 under the project COHERENT (PCI2020-120718-2); and by the European Commission NextGenerationEU, through CSIC’s Thematic Platforms (PTI+ Neuro-Aging). A. Olivares-Alarcos is supported by the European Social Fund and the Ministry of Business and Knowledge of Catalonia through the FI 2020 grant.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Semantic State Prediction in Robotic Cloth Manipulation

  • Tzelepis, Georgios
  • Borràs, Julia
  • Eren Erdal, Aksoy
  • Alenyà, Guillem
State estimation of deformable objects such as textiles is notorious difficult due to its extreme high dimensionality and complexity. Lack of data and benchmarks is another challenge impeding progress in robotic cloth manipulation. In this paper, we make a first attempt to solve the problem of semantic state estimation through RGB-D data only in an end-to-end manner with the help of deep neural networks. Since neural networks require large amounts of labeled data, we introduce a novel Mujoco simulator to generate a large-scale fully annotated robotic textile manipulation dataset including bimanual actions. Finally, we provide a set of baseline deep neural networks and benchmark them on the problem of semantic state prediction on our proposed dataset., This work has been partially funded by MCIN/AEI/10.13039/501100011033, Spain, under the project CHLOE-GRAPH (PID2020- 119244GB-I00); by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); and by MCIN/AEI/10.13039/501100011033, Spain, and by the European Union NextGenerationEU/ PRTR, Spain, under the project COHERENT (PCI2020-120718-2);, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A Virtual Reality Framework For Fast Dataset Creation Applied to Cloth Manipulation with Automatic Semantic Labelling

  • Borràs, Julia
  • Boix-Granell, Arnau
  • Foix, Sergi
  • Torras, Carme
Trabajo presentado en la IEEE International Conference on Robotics and Automation (ICRA), celebrada en Londres (UK), del 29 de mayo al 2 de junio de 2024, Teaching complex manipulation skills, such as folding garments, to a bi-manual robot is a very challenging task, which is often tackled through learning from demon-stration. The few datasets of garment-folding demonstrations available nowadays to the robotics research community have been either gathered from human demonstrations or generated through simulation. The former have the great difficulty of perceiving both cloth state and human action as well as transferring them to the dynamic control of the robot, while the latter require coding human motion into the simulator in open loop, i.e., without incorporating the visual feedback naturally used by people, resulting in far-from-realistic movements. In this article, we present an accurate dataset of human cloth folding demonstrations. The dataset is collected through our novel virtual reality (VR) framework, based on Unity's 3D platform and the use of an HTC Vive Pro system. The framework is capable of simulating realistic garments while allowing users to interact with them in real time through handheld controllers. By doing so, and thanks to the immersive experience, our framework permits exploiting human visual feedback in the demonstrations while at the same time getting rid of the difficulties of capturing the state of cloth, thus simplifying data acquisition and resulting in more realistic demonstrations. We create and make public a dataset of cloth manipulation sequences, whose cloth states are semantically labeled in an automatic way by using a novel low-dimensional cloth representation that yields a very good separation between different cloth configurations., The research leading to these results receives funding from the European Research Council (ERC) from the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE: CLOTH manIpulation Learning from DEmonstrations) and project SoftEnable (HORIZONCL4- 2021-DIGITAL-EMERGING-01-101070600). Authors also received funding from project CHLOE-GRAPH (PID2020-118649RB-I00) funded by MCIN/ AEI /10.13039/501100011033 and COHERENT (PCI2020-120718- 2) funded by MCIN/ AEI /10.13039/501100011033 and cofunded by the ”European Union NextGenerationEU/PRTR”., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A Bayesian framework for learning proactive robot behaviour in assistive tasks

  • Andriella, Antonio
  • Cucciniello, Ilenia
  • Origlia, Antonio
  • Rossi, Silvia
Socially assistive robots represent a promising tool in assistive contexts for improving people’s quality of life and well-being through social, emotional, cognitive, and physical support. However, the effectiveness of interactions heavily relies on the robots’ ability to adapt to the needs of the assisted individuals and to offer support proactively, before it is explicitly requested. Previous work has primarily focused on defining the actions the robot should perform, rather than considering when to act and how confident it should be in a given situation. To address this gap, this paper introduces a new data-driven framework that involves a learning pipeline, consisting of two phases, with the ultimate goal of training an algorithm based on Influence Diagrams. The proposed assistance scenario involves a sequential memory game, where the robot autonomously learns what assistance to provide when to intervene, and with what confidence to take control. The results from a user study showed that the proactive behaviour of the robot had a positive impact on the users’ game performance. Users obtained higher scores, made fewer mistakes, and requested less assistance from the robot. The study also highlighted the robot’s ability to provide assistance tailored to users’ specific needs and anticipate their requests., This work was partially funded by the Italian Ministry for Universities and Research (MUR) under the grant FIT4MEDROB (MUR: PNC0000007) (S. Rossi), by the Italian MUR and EU under the CHIST-ERA IV project COHERENT (PCI2020-120718-2) (I. Cucciniello), and by the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 801342 (Tecniospring INDUSTRY) and by the EU-founded project grant agreement No 101070930 (VALAWAI) (A. Andriella)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Ontological Modeling and Reasoning for Comparison and Contrastive Narration of Robot Plans

  • Olivares-Alarcos, Alberto
  • Foix, Sergi
  • Borràs, Julia
  • Canal, Gerard
  • Alenyà, Guillem
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., This work was partially supported by Project PID2020-118649RBI00 funded by MCIN/ AEI /10.13039/501100011033; Project PCI2020- 120718-2 funded by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR"; Project EP/V062506/1 funded by EPSRC (UK); and also by the European Union under the project ARISE (HORIZON-CL4-2023-DIGITAL-EMERGING-01- 101135959). G. Canal was supported by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme. A. Olivares-Alarcos was supported by the European Social Fund and the Ministry of Business and Knowledge of Catalonia through the FI 2020 grant., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

PlanCollabNL: Leveraging Large Language Models for Adaptive Plan Generation in Human-Robot Collaboration

  • Izquierdo-Badiola, Silvia
  • Canal, Gerard
  • Rizzo, Carlos
  • Alenyà, Guillem
"Hey, robot. Let's tidy up the kitchen. By the way, I have back pain today". How can a robotic system devise a shared plan with an appropriate task allocation from this abstract goal and agent condition? Classical AI task planning has been explored for this purpose, but it involves a tedious definition of an inflexible planning problem. Large Language Models (LLMs) have shown promising generalisation capabilities in robotics decision-making through knowledge extraction from Natural Language (NL). However, the translation of NL information into constrained robotics domains remains a challenge. In this paper, we use LLMs as translators between NL information and a structured AI task planning problem, targeting human-robot collaborative plans. The LLM generates information that is encoded in the planning problem, including specific subgoals derived from an NL abstract goal, as well as recommendations for subgoal allocation based on NL agent conditions. The framework, PlanCollabNL, is evaluated for a number of goals and agent conditions, and the results show that correct and executable plans are found in most cases. With this framework, we intend to add flexibility and generalisation to HRC plan generation, eliminating the need for a manual and laborious definition of restricted planning problems and agent models., This work was partially financed by MCIN/ AEI /10.13039/501100011033 and by the “European Union NextGenerationEU/PRTR” under the project ROB-IN (PLEC2021-007859); and by the project COHERENT funded by MCIN/ AEI /10.13039/501100011033, Spain, the “European Union NextGenerationEU/ PRTR”, Spain, (PCI2020-120718-2), and by UKRI (EP/V062506/1)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Semantic State Estimation in Robot Cloth Manipulations Using Domain Adaptation from Human Demonstrations

  • Tzelepis, Georgies
  • Aksoy, Eren Erdal
  • Borràs, Julia
  • Alenyà, Guillem
Deformable object manipulations, such as those involving textiles, present a significant challenge due to their high dimensionality and complexity. In this paper, we propose a solution for estimating semantic states in cloth manipulation tasks. To this end, we introduce a new, large-scale, fully-annotated RGB image dataset of semantic states featuring a diverse range of human demonstrations of various complex cloth manipulations. This effectively transforms the problem of action recognition into a classification task. We then evaluate the generalizability of our approach by employing domain adaptation techniques to transfer knowledge from human demonstrations to two distinct robotic platforms: Kinova and UR robots. Additionally, we further improve performance by utilizing a semantic state graph learned from human manipulation data., This work has been partially funded by MCIN/ AEI /10.13039/ 501100011033, Spain, under the project CHLOE-GRAPH (PID2020- 119244GB-I00); by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); and by MCIN/ AEI /10.13039/501100011033, Spain, and by the “European Union NextGenerationEU/ PRTR, Spain, under the project COHERENT (PCI2020-120718-2);, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Standardization of Cloth Objects and its Relevance in Robotic Manipulation

  • García-Camacho, Irene
  • Longhini, Alberta
  • Welle, Michael
  • Alenyà, Guillem
  • Kragic, Danica
  • Borràs, Julia
The field of robotics faces inherent challenges in manipulating deformable objects, particularly in understanding and standardising fabric properties like elasticity, stiffness, and friction. While the significance of these properties is evident in the realm of cloth manipulation, accurately categorising and comprehending them in real-world applications remains elusive. This study sets out to address two primary objectives: (1) to provide a framework suitable for robotics applications to characterise cloth objects, and (2) to study how these properties influence robotic manipulation tasks. Our preliminary results validate the framework's ability to characterise cloth properties and compare cloth sets, and reveal the influence that different properties have on the outcome of five manipulation primitives. We believe that, in general, results on the manipulation of clothes should be reported along with a better description of the garments used in the evaluation. This paper proposes a set of these measures., This work has been supported by project PID2020-118649RB-I00 funded by MCIN/ AEI /10.13039/501100011033, by project PCI2020-120718-2 funded by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR”, by CSIC iMOVE 2023 grant (code 23254) and by the European Research Council (ERCBIRD), Swedish Research Council and Knut and Alice Wallenberg Foundation, the National Science Foundation under NSF CAREER grant number: IIS-2046491, Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Evaluating the effect of theory of mind on people’s trust in a faulty robot

  • Rossi, Alessandra
  • Andriella, Antonio|||0000-0002-6641-6450
  • Rossi, Silvia
  • Torras, Carme|||0000-0002-2933-398X
  • Alenyà Ribas, Guillem|||0000-0002-6018-154X
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The success of human-robot interaction is strongly affected by the people's ability to infer others' intentions and behaviours, and the level of people's trust that others will abide by their same principles and social conventions to achieve a common goal. The ability of understanding and reasoning about other agents' mental states is known as Theory of Mind (ToM). ToM and trust, therefore, are key factors in the positive outcome of human-robot interaction. We believe that a robot endowed with a ToM is able to gain people's trust, even when this may occasionally make errors. In this work, we present a user study in the field in which participants (N=123) interacted with a robot that may or may not have a ToM, and may or may not exhibit erroneous behaviour. Our findings indicate that a robot with ToM is perceived as more reliable, and they trusted it more than a robot without a ToM even when the robot made errors. Finally, ToM results to be a key driver for tuning people's trust in the robot even when the initial condition of the interaction changed (i.e., loss and regain of trust in a longer relationship)., This work has been supported by Italian PON R&I 2014-2020 - REACT-EU (CUP E65F21002920003); by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR” under the project ROBIN (PLEC2021-007859) and the project COHERENT (PCI2020-120718-2); by the ”European Union NextGenerationEU/PRTR” through CSIC’s Thematic Platforms (PTI+ Neuro-Aging) and by the European Union’s Horizon 2020 research and innovation programme PRO-CARED (no.801342) under Marie Skłodowska-Curie grant agreement (Tecniospring INDUSTRY) and the Government of Catalonia’s Agency for Business Competitiveness (ACCIO)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

User interactions and negative examples to improve the learning of semantic rules in a cognitive exercise scenario

  • Suárez Hernández, Alejandro
  • Andriella, Antonio|||0000-0002-6641-6450
  • Torras, Carme|||0000-0002-2933-398X
  • Alenyà Ribas, Guillem|||0000-0002-6018-154X
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Enabling a robot to perform new tasks is a complex endeavor, usually beyond the reach of non-technical users. For this reason, research efforts that aim at empowering end-users to teach robots new abilities using intuitive modes of interaction are valuable. In this article, we present INtuitive PROgramming 2 (INPRO2), a learning framework that allows inferring planning actions from demonstrations given by a human teacher. INPRO2 operates in an assistive scenario, in which the robot may learn from a healthcare professional (a therapist or caregiver) new cognitive exercises that can be later administered to patients with cognitive impairment. INPRO2 features significant improvements over previous work, namely: (1) exploitation of negative examples; (2) proactive interaction with the teacher to ask questions about the legality of certain movements; and (3) learning goals in addition to legal actions. Through simulations, we show the performance of different proactive strategies for gathering negative examples. Real-world experiments with human teachers and a TIAGo robot are also presented to qualitatively illustrate INPRO2., The research leading to these results receives funding from the EU H2020 Programme under grant agreement ERC–2016–ADG–741930 (CLOTHILDE); by MCIN/ AEI /10.13039/501100011033 under the project CHLOE-GRAPH (PID2020-119244GB-I00); by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR under the project COHERENT (PCI2020-120718-2); AA acknowledges the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 801342 (Tecniospring INDUSTRY); ASH acknowledges the financial support of the Apadrina la Ciencia association and of the Ford Spanish branch., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Ontological modeling and reasoning for comparison and contrastive narration of robot plans

  • Olivares Alarcos, Alberto|||0000-0002-7733-7715
  • Foix, Sergi
  • Borràs Sol, Júlia|||0000-0002-1662-2037
  • Canal Camprodon, Gerard|||0000-0002-6718-1198
  • Alenyà Ribas, Guillem|||0000-0002-6018-154X
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Ontological modeling and reasoning for comparison and contrastive narration of robot plans

  • Olivares Alarcos, Alberto
  • Foix, Sergi
  • Borràs Sol, Júlia
  • Canal Camprodon, Gerard
  • Alenyà Ribas, Guillem
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Evaluating the effect of theory of mind on people’s trust in a faulty robot

  • Rossi, Alessandra
  • Andriella, Antonio
  • Rossi, Silvia
  • Torras, Carme
  • Alenyà Ribas, Guillem
© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The success of human-robot interaction is strongly affected by the people's ability to infer others' intentions and behaviours, and the level of people's trust that others will abide by their same principles and social conventions to achieve a common goal. The ability of understanding and reasoning about other agents' mental states is known as Theory of Mind (ToM). ToM and trust, therefore, are key factors in the positive outcome of human-robot interaction. We believe that a robot endowed with a ToM is able to gain people's trust, even when this may occasionally make errors. In this work, we present a user study in the field in which participants (N=123) interacted with a robot that may or may not have a ToM, and may or may not exhibit erroneous behaviour. Our findings indicate that a robot with ToM is perceived as more reliable, and they trusted it more than a robot without a ToM even when the robot made errors. Finally, ToM results to be a key driver for tuning people's trust in the robot even when the initial condition of the interaction changed (i.e., loss and regain of trust in a longer relationship)., This work has been supported by Italian PON R&I 2014-2020 - REACT-EU (CUP E65F21002920003); by the European Union’s Horizon 2020 under ERC Advanced Grant CLOTHILDE (no. 741930); by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR” under the project ROBIN (PLEC2021-007859) and the project COHERENT (PCI2020-120718-2); by the ”European Union NextGenerationEU/PRTR” through CSIC’s Thematic Platforms (PTI+ Neuro-Aging) and by the European Union’s Horizon 2020 research and innovation programme PRO-CARED (no.801342) under Marie Skłodowska-Curie grant agreement (Tecniospring INDUSTRY) and the Government of Catalonia’s Agency for Business Competitiveness (ACCIO)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

User interactions and negative examples to improve the learning of semantic rules in a cognitive exercise scenario

  • Suárez Hernández, Alejandro
  • Andriella, Antonio
  • Torras, Carme
  • Alenyà Ribas, Guillem
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Enabling a robot to perform new tasks is a complex endeavor, usually beyond the reach of non-technical users. For this reason, research efforts that aim at empowering end-users to teach robots new abilities using intuitive modes of interaction are valuable. In this article, we present INtuitive PROgramming 2 (INPRO2), a learning framework that allows inferring planning actions from demonstrations given by a human teacher. INPRO2 operates in an assistive scenario, in which the robot may learn from a healthcare professional (a therapist or caregiver) new cognitive exercises that can be later administered to patients with cognitive impairment. INPRO2 features significant improvements over previous work, namely: (1) exploitation of negative examples; (2) proactive interaction with the teacher to ask questions about the legality of certain movements; and (3) learning goals in addition to legal actions. Through simulations, we show the performance of different proactive strategies for gathering negative examples. Real-world experiments with human teachers and a TIAGo robot are also presented to qualitatively illustrate INPRO2., The research leading to these results receives funding from the EU H2020 Programme under grant agreement ERC–2016–ADG–741930 (CLOTHILDE); by MCIN/ AEI /10.13039/501100011033 under the project CHLOE-GRAPH (PID2020-119244GB-I00); by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR under the project COHERENT (PCI2020-120718-2); AA acknowledges the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 801342 (Tecniospring INDUSTRY); ASH acknowledges the financial support of the Apadrina la Ciencia association and of the Ford Spanish branch., Peer Reviewed, Postprint (author's final draft)