Pasar al contenido principal

AGARRE, REPRESENTACION Y PLANIFICACION DE ACCIONES CON OBJETOS TIPO TELA

PID2020-118649RB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 36
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Household Cloth Object Set: Fostering Benchmarking in Deformable Object Manipulation

  • García-Camacho, Irene
  • Borràs, Julia
  • Calli, Berk
  • Norton, Adam
  • Alenyà, Guillem
Benchmarking of robotic manipulations is one of the open issues in robotic research. An important factor that has enabled progress in this area in the last decade is the existence of common object sets that have been shared among different research groups. However, the existing object sets are very limited when it comes to cloth-like objects that have unique particularities and challenges. This letter is a first step towards the design of a cloth object set to be distributed among research groups from the robotics cloth manipulation community. We present a set of household cloth objects and related tasks that serve to expose the challenges related to gathering such an object set and propose a roadmap to the design of common benchmarks in cloth manipulation tasks, with the intention to set the grounds for a future debate in the community that will be necessary to foster benchmarking for the manipulation of cloth-like objects. Some RGB-D and object scans are collected as examples for the relevant configurations and shared in http://www.iri.upc.edu/groups/perception/ClothObjectSet/., The work of IGC is partially supported by MCIN/ AEI /10.13039/501100011033 and by the ”European Union” under project BURG (PCI2019-103447); JB thanks MCIN/ AEI /10.13039/501100011033 under project CHLOE-GRAPH (PID2020-118649RB-I00); GA acknowledges the EU H2020 Programme under grant agreement ERC–2016–ADG–741930 (CLOTHILDE); and BC thanks the National Science Foundation under grant IIS-1900953
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Improved Task Planning through Failure Anticipation in Human-Robot Collaboration

  • Izquierdo Badiola, Silvia
  • Canal, Gerard
  • Rizzo, Carlos
  • Alenyà, Guillem
Trabajo presentado en la International Conference on Robotics and Automation (ICRA), celebrada en Philadelphia (Estados Unidos), del 23 al 27 de mayo de 2022, Human-Robot Collaboration (HRC) has become a major trend in robotics in recent years with the idea of combining the strengths from both humans and robots. In order to share the work to be done, many task planning approaches have been implemented. However, they don't fully satisfy the required adaptability in human-robot collaborative tasks, with most approaches not considering neither the state of the human partner nor the possibility of adapting the collaborative plan during execution or even anticipating failures. In this paper, we present a planning system for human-robot collaborative plans that takes into account the agents' states and deals with unforeseen human behaviour, by replanning in anticipation when the human state changes to prevent action failure. The human state is defined in terms of capacity, knowledge and motivation. The system has been implemented in a standardised environment using the Planning Domain Definition Language (PDDL) and the modular ROSPlan framework, and we have validated the approach in multiple simulation settings. Our results show that using the human model fosters an appropriate task allocation while allowing failure anticipation, replanning in time to prevent it., This work was financially supported by the Catalan Government through the funding grant ACCIO-Eurecat, and partially supported by MCIN/ AEI ´ /10.13039/501100011033 under the project CHLOE-GRAPH (PID2020- 118649RB-l00); by MCIN/ AEI /10.13039/501100011033 and by the European Union NextGenerationEU/PRTR under the project COHERENT (PCI2020-120718-2). Gerard Canal has been partially supported by EPSRC grant THuMP (EP/R033722/1) and by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Representation of Cloth States based on a Derivative of the Gauss Linking Integral

  • Coltraro, Franco
  • Fontana, Josep
  • Amorós, Jaume
  • Alberich-Carramiñana, Maria
  • Borràs, Julia
  • Torras, Carme
Robotic manipulation of cloth is a complex task because of the infinite-dimensional shape-state space of textiles, which makes their state estimation very difficult. In this paper we introduce the dGLI Cloth Coordinates, a finite low-dimensional representation of cloth states that allows us to efficiently distinguish a large variety of different folded states, opening the door to efficient learning methods for cloth manipulation planning and control. Our representation is based on a directional derivative of the Gauss Linking Integral and allows us to represent spatial as well as planar folded configurations in a consistent and unified way. The proposed dGLI Cloth Coordinates are shown to be more accurate in the representation of cloth states and significantly more sensitive to changes in grasping affordances than other classic shape distance methods. Finally, we apply our representation to real images of a cloth, showing that with it we can identify the different states using a distance-based classifier., This work was developed under the project CLOTHILDE which has received funding from the European Research Council (ERC) under the EU-Horizon 2020 research and innovation programme (grant agreement No. 741930). M. Alberich-Carramiñana is also with the Barcelona Graduate School of Mathematics (BGSMath) and the Institut de Matemàtiques de la UPC-BarcelonaTech (IMTech), and she and J. Amorós are partially supported by the Spanish State Research Agency AEI/10.13039/501100011033 grant PID2019-103849GB-I00 and by the AGAUR project 2021 SGR 00603 Geometry of Manifolds and Applications, GEOMVAP. J. Borràs is supported by the Spanish State Research Agency MCIN/ AEI /10.13039/501100011033 grant PID2020-118649RB-I00 (CHLOE-GRAPH project).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Generating predicate suggestions based on the space of plans: an example of planning with preferences

  • Canal, Gerard
  • Torras, Carme
  • Alenyà, Guillem
Task planning in human–robot environments tends to be particularly complex as it involves additional uncertainty introduced by the human user. Several plans, entailing few or various differences, can be obtained to solve the same given task. To choose among them, the usual least-cost plan criteria is not necessarily the best option, because here, human constraints and preferences come into play. Knowing these user preferences is very valuable to select an appropriate plan, but the preference values are usually hard to obtain. In this context, we propose the Space-of-Plans-based Suggestions (SoPS) algorithms that can provide suggestions for some planning predicates, which are used to define the state of the environment in a task planning problem where actions modify the predicates. We denote these predicates as suggestible predicates, of which user preferences are a particular case. The first algorithm is able to analyze the potential effect of the unknown predicates and provide suggestions to values for these unknown predicates that may produce better plans. The second algorithm is able to suggest changes to already known values that potentially improve the obtained reward. The proposed approach utilizes a Space of Plans Tree structure to represent a subset of the space of plans. The tree is traversed to find the predicates and the values that would most increase the reward, and output them as a suggestion to the user. Our evaluation in three preference-based assistive robotics domains shows how the proposed algorithms can improve task performance by suggesting the most effective predicate values first., This work has been partially supported by the ERC project Clothilde (ERC-2016-ADG-741930); by MCIN/AEI/10.13039/501100011033 under the project CHLOE-GRAPH (PID2020-118649RB-l00); by the European Union NextGenerationEU/PRTR under the project ROB-IN (PLEC2021-007859); and by the CHIST-ERA project COHERENT (EPSRC EP/V062506/1). Gerard Canal has also been supported by the Spanish Ministry of Education, Culture and Sport by the FPU15/00504 doctoral grant and by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Controlled Gaussian process dynamical models with application to robotic cloth manipulation

  • Amadio, Fabio
  • Delgado-Guerrero, Juan Antonio
  • Colomé, Adrià
  • Torras, Carme
Over the last years, significant advances have been made in robotic manipulation, but still, the handling of non-rigid objects, such as cloth garments, is an open problem. Physical interaction with non-rigid objects is uncertain and complex to model. Thus, extracting useful information from sample data can considerably improve modeling performance. However, the training of such models is a challenging task due to the high-dimensionality of the state representation. In this paper, we propose Controlled Gaussian Process Dynamical Models (CGPDMs) for learning high-dimensional, nonlinear dynamics by embedding them in a low-dimensional manifold. A CGPDM is constituted by a low-dimensional latent space, with an associated dynamics where external control variables can act and a mapping to the observation space. The parameters of both maps are marginalized out by considering Gaussian Process priors. Hence, a CGPDM projects a high-dimensional state space into a smaller dimension latent space, in which it is feasible to learn the system dynamics from training data. The modeling capacity of CGPDM has been tested in both a simulated and a real scenario, where it proved to be capable of generalizing over a wide range of movements and confidently predicting the cloth motions obtained by previously unseen sequences of control actions., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was partially developed in the context of the project CLOTHILDE (“CLOTH manIpulation Learning from DEmonstrations”), which has received funding from ERC under the European Union’s Horizon 2020 research and innovation program (Advanced Grant agreement No 741930). This work has also received funding from project CHLOE-GRAPH (PID2020-118649RB-I00) funded by MCIN/ AEI /10.13039/501100011033., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Virtual Reality Framework For Fast Dataset Creation Applied to Cloth Manipulation with Automatic Semantic Labelling

  • Borràs, Julia
  • Boix-Granell, Arnau
  • Foix, Sergi
  • Torras, Carme
Trabajo presentado en la IEEE International Conference on Robotics and Automation (ICRA), celebrada en Londres (UK), del 29 de mayo al 2 de junio de 2024, Teaching complex manipulation skills, such as folding garments, to a bi-manual robot is a very challenging task, which is often tackled through learning from demon-stration. The few datasets of garment-folding demonstrations available nowadays to the robotics research community have been either gathered from human demonstrations or generated through simulation. The former have the great difficulty of perceiving both cloth state and human action as well as transferring them to the dynamic control of the robot, while the latter require coding human motion into the simulator in open loop, i.e., without incorporating the visual feedback naturally used by people, resulting in far-from-realistic movements. In this article, we present an accurate dataset of human cloth folding demonstrations. The dataset is collected through our novel virtual reality (VR) framework, based on Unity's 3D platform and the use of an HTC Vive Pro system. The framework is capable of simulating realistic garments while allowing users to interact with them in real time through handheld controllers. By doing so, and thanks to the immersive experience, our framework permits exploiting human visual feedback in the demonstrations while at the same time getting rid of the difficulties of capturing the state of cloth, thus simplifying data acquisition and resulting in more realistic demonstrations. We create and make public a dataset of cloth manipulation sequences, whose cloth states are semantically labeled in an automatic way by using a novel low-dimensional cloth representation that yields a very good separation between different cloth configurations., The research leading to these results receives funding from the European Research Council (ERC) from the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE: CLOTH manIpulation Learning from DEmonstrations) and project SoftEnable (HORIZONCL4- 2021-DIGITAL-EMERGING-01-101070600). Authors also received funding from project CHLOE-GRAPH (PID2020-118649RB-I00) funded by MCIN/ AEI /10.13039/501100011033 and COHERENT (PCI2020-120718- 2) funded by MCIN/ AEI /10.13039/501100011033 and cofunded by the ”European Union NextGenerationEU/PRTR”., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Benchmarking the Sim-to-Real Gap in Cloth Manipulation

  • Blanco-Mulero, David
  • Barbany, Oriol
  • Alcan, Gokhan
  • Colomé, Adrià
  • Torras, Carme
  • Kyrki, Ville
Realistic physics engines play a crucial role for learning to manipulate deformable objects such as garments in simulation. By doing so, researchers can circumvent challenges such as sensing the deformation of the object in the real-world. In spite of the extensive use of simulations for this task, few works have evaluated the reality gap between deformable object simulators and real-world data. We present a benchmark dataset to evaluate the sim-to-real gap in cloth manipulation. The dataset is collected by performing a dynamic as well as a quasi-static cloth manipulation task involving contact with a rigid table. We use the dataset to evaluate the reality gap, computational time, and simulation stability of four popular deformable object simulators: MuJoCo, Bullet, Flex, and SOFA. Additionally, we discuss the benefits and drawbacks of each simulator. The benchmark dataset is open-source. Supplementary material, videos, and code, can be found at https://sites.google.com/view/cloth-sim2real-benchmark., This work was supported in part by Academy of Finland under Grant 317020, in part by Business Finland (decision 9249/31/2021), in part by EU’s H2020 Programme through the CLOTHILDE Project under Grant ERC-2016-ADG-741930, in part by EU’s Horizon Europe Programme through the SoftEnable Project under Grant Agreement 101070600, and in part by MCIN/AEI/10.13039/501100011033 through CHLOE-GRAPH Project under Grant PID2020-118649RB-I00., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Model Predictive Control for Dynamic Cloth Manipulation: Parameter Learning and Experimental Validation

  • Luque Acera, Adrià
  • Parent, David
  • Colomé, Adrià
  • Ocampo-Martínez, Carlos
  • Torras, Carme
Robotic cloth manipulation is a challenging problem for robotic systems. Textile items can adopt multiple configurations and shapes during their manipulation. Hence, robots should not only understand the current configuration of the item but also be able to predict its future possible behaviors and perform real-time control during manipulation. This article addresses the problem of indirectly controlling the configuration of certain points of a textile object, by applying actions on other parts of it through the use of a model predictive control (MPC) strategy. MPC allows to foresee the behavior of indirectly controlled points, while satisfying physical/operational constraints. This is done by first identifying the optimal control signals that may constitute the desired future cloth configuration. After that, a dynamic model of the item will be used and sensor data will allow to update the belief on the object's state and close the loop. This article investigates how grasping the upper corners of a square piece of cloth can allow to track a reference trajectory of the pieces' lower corners. To do so, we propose and validate a linear cloth model that allows solving the MPC optimization problem in real time. Reinforcement learning (RL) techniques are used to learn the parameters of the proposed cloth model and to tune the resulting MPC. The full control scheme was implemented and executed in a real robot, obtaining accurate tracking results in adverse conditions., This work was developed in the context of the project CLOTHILDE (”CLOTH manIpulation Learning from DEmonstrations”), which has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programmee (Advanced Grant agreement No 741930). The work is also supported by Project PID2020- 118649RB-I00 funded by MCIN/ AEI /10.13039/501100011033, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Fitting Parameters of Linear Dynamical Systems to Regularize Forcing Terms in Dynamical Movement Primitives

  • Stulp, Freek
  • Colomé, Adrià
  • Torras, Carme
Due to their flexibility and ease of use, Dynamical Movement Primitives (DMPs) are widely used in robotics applications and research. DMPs combine linear dynamical systems to achieve robustness to perturbations and adaptation to moving targets with non-linear function approximators to fit a wide range of demonstrated trajectories.We propose a novel DMP formulation with a generalized logistic function as a delayed goal system. This formulation inherently has low initial jerk, and generates the bell-shaped velocity profiles that are typical of human movement. As the novel formulation is more expressive, it is able to fit a wide range of human demonstrations well, also without a non-linear forcing term. We exploit this increased expressiveness by automating the fitting of the dynamical system parameters through opti-mization. Our experimental evaluation demonstrates that this optimization regularizes the forcing term, and improves the interpolation accuracy of parametric DMPs., This work was partially funded by the European ERC/EIC/Horizon projects with grant numbers 741930 (CLOTHILDE), 951992 (VeriDream), and 101070596 (euROBIN), as well the CSIC project 202350E080 (ClothIRI), and the MCIN/AEI project PID2020-118649RBI00 (CHLOE-GRAPH)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Introducing Social Robots to Assess Frailty in Older Adults

  • Civit, Aniol
  • Andriella, Antonio
  • Barrue, Cristian
  • Antonio, Maite
  • Boqué, Concepción
  • Alenyà, Guillem
Frailty is a crucial indicator in determining the well-being of older adults in terms of their health. With the growing number of elderly people, the demand for geriatricians is increasing, which means that they have less time to spend with each patient. The current methods for frailty assessment use simple tests that are time-consuming and do not require specific medical expertise. To address this issue, this paper proposes the use of social robots to assess frailty autonomously. It presents a practical proposal that defines the robot's behavior and explains the design and implementation concepts. Finally, it discusses some of the challenges that may arise from introducing social robots as frailty evaluators., This work was supported by the project ROB-IN PLEC2021-007859 funded by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR"; project CHLOE-GRAPH PID2020-118649RB-I00 funded by MCIN/AEI /10.13039/501100011033; and the 23S06141-001 FRAILWATCH project funded by Barcelona Ciencia 2020-2023 Plan., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

NYAM: The Role of Configurable Engagement Strategies in Robotic-Assisted Feeding

  • Barrué, Cristian
  • Suárez, Alejandro
  • Inzitari, Marco
  • Ribera, Aida
  • Alenyà, Guillem
In some contexts, like geriatric hospitals, the number of patients requiring assistance with feeding is very high and robots may be an effective tool for caregivers to provide better assistance. This article introduces NYAM, a robot designed to aid in the feeding process for individuals. Our robot is equipped with a mechanism to effectively recapture the person's attention whenever necessary. The mechanism is easily adjustable by the caregivers, allowing the straightforward customisation of the feeding service. The approach was evaluated, within a geriatric hospital, with 9 patients who used the robot for 5 consecutive days. We argue that incorporating enhanced social aspects into the robot is imperative to enhance the effectiveness and acceptance of this solution., This work was supported by the project ROB-IN PLEC2021-007859 funded by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR"; project CHLOE-GRAPH PID2020-118649RB-I00 funded by MCIN/ AEI /10.13039/501100011033; and project PIONEER from PSPV., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Ontological Modeling and Reasoning for Comparison and Contrastive Narration of Robot Plans

  • Olivares-Alarcos, Alberto
  • Foix, Sergi
  • Borràs, Julia
  • Canal, Gerard
  • Alenyà, Guillem
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., This work was partially supported by Project PID2020-118649RBI00 funded by MCIN/ AEI /10.13039/501100011033; Project PCI2020- 120718-2 funded by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGenerationEU/PRTR"; Project EP/V062506/1 funded by EPSRC (UK); and also by the European Union under the project ARISE (HORIZON-CL4-2023-DIGITAL-EMERGING-01- 101135959). G. Canal was supported by the Royal Academy of Engineering and the Office of the Chief Science Adviser for National Security under the UK Intelligence Community Postdoctoral Research Fellowship programme. A. Olivares-Alarcos was supported by the European Social Fund and the Ministry of Business and Knowledge of Catalonia through the FI 2020 grant., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Standardization of Cloth Objects and its Relevance in Robotic Manipulation

  • García-Camacho, Irene
  • Longhini, Alberta
  • Welle, Michael
  • Alenyà, Guillem
  • Kragic, Danica
  • Borràs, Julia
The field of robotics faces inherent challenges in manipulating deformable objects, particularly in understanding and standardising fabric properties like elasticity, stiffness, and friction. While the significance of these properties is evident in the realm of cloth manipulation, accurately categorising and comprehending them in real-world applications remains elusive. This study sets out to address two primary objectives: (1) to provide a framework suitable for robotics applications to characterise cloth objects, and (2) to study how these properties influence robotic manipulation tasks. Our preliminary results validate the framework's ability to characterise cloth properties and compare cloth sets, and reveal the influence that different properties have on the outcome of five manipulation primitives. We believe that, in general, results on the manipulation of clothes should be reported along with a better description of the garments used in the evaluation. This paper proposes a set of these measures., This work has been supported by project PID2020-118649RB-I00 funded by MCIN/ AEI /10.13039/501100011033, by project PCI2020-120718-2 funded by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR”, by CSIC iMOVE 2023 grant (code 23254) and by the European Research Council (ERCBIRD), Swedish Research Council and Knut and Alice Wallenberg Foundation, the National Science Foundation under NSF CAREER grant number: IIS-2046491, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Towards Explainable Proactive Robot Interactions for Groups of People in Unstructured Environments

  • Love, Tamlin
  • Andriella, Antonio
  • Alenyà, Guillem
For social robots to be able to operate in unstructured public spaces, they need to be able to gauge complex factors such as human-robot engagement and inter-person social groups, and be able to decide how and with whom to interact. Additionally, such robots should be able to explain their decisions after the fact, to improve accountability and confidence in their behavior. To address this, we present a two-layered proactive system that extracts high-level social features from low-level perceptions and uses these features to make high-level decisions regarding the initiation and maintenance of human-robot interactions. With this system outlined, the primary focus of this work is then a novel method to generate counterfactual explanations in response to a variety of contrastive queries. We provide an early proof of concept to illustrate how these explanations can be generated by leveraging the two-layer system., This work was supported by Horizon Europe under the MSCA grant agreement No 101072488 (TRAIL); by the "European Union NextGenerationEU/PRTR" project CHLOE-GRAPH PID2020-118649RBI00 funded by MCIN/ AEI /10.13039/ 501100011033; A. Andriella acknowledges the European Union’s Horizon 2020 research and innovation program under the Marie Skłodowska-Curie grant agreement No 801342 (Tecniospring INDUSTRY)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

What Would I Do If...? Promoting Understanding in HRI through Real-Time Explanations in the Wild

  • Love, Tamlin
  • Andriella, Antonio
  • Alenyà, Guillem
As robots become more and more integrated in human spaces, it is increasingly important for them to be able to explain their decisions to the people they interact with. These explanations need to be generated automatically and in real-time in response to decisions taken in dynamic and often unstructured environments. However, most research in explainable human-robot interaction only considers explanations (often manually selected) presented in controlled environments. We present an explanation generation method based on counterfactuals and demonstrate its use in an "in-the-wild"experiment using automatically generated and selected explanations of autonomous interactions with real people to assess the effect of these explanations on participants' ability to predict the robot's behaviour in hypothetical scenarios. Our results suggest that explanations aid one's ability to predict the robot's behaviour, but also that the addition of counterfactual statements may add some burden and counteract this beneficial effect., This work was supported by Horizon Europe under the MSCA grant agreement No 101072488 (TRAIL); by the “European Union NextGenerationEU/PRTR” project CHLOE-GRAPH PID2020-118649RB-I00 funded by MCIN/ AEI /10.13039/ 501100011033; by the EU-founded project grant agreement No 101070930 (VALAWAI); and by the Research Council of Norway under the project SECUROPS (INT-NO/0875)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Datos de investigación Set de datos (Dataset)

Tracking cloth deformation: a novel dataset for closing the sim-to-real gap for robotic cloth manipulation learning

  • Coltraro, Franco
  • Borràs, Julia
We present a cloth dataset consisting of 120 high-quality recordings of several textiles during dynamic motions. Using a Motion Capture System, we record the location of key-points on the cloth surface of four types of fabrics (cotton, denim, wool and polyester) of two sizes (A2 and A3) and at different speeds. The scenarios considered are all dynamic and involve rapid shaking and twisting of the textiles, collisions with frictional objects, strong hits with a long rigid object and even self-collisions. For more information about the dataset, see: Franco Coltraro, Júlia Borràs, Maria Alberich-Carramiñana and Carme Torras. Tracking cloth deformation: a novel dataset for closing the sim-to-real gap for robotic cloth manipulation learning to appear in International Journal of Robotics Research (2025)., - F. Coltraro is supported by Momentum CSIC Programme project MMT24-IRII-01 and by RobIRI 2021 SGR 00514. - J. Borras is supported by the project PID2020-118649RB-I00(CHLOE-GRAPH) funded by MCIN/ AEI /10.13039/501100011033., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Automating the hand layup process: On the removal of protective films with collaborative robots

  • Kermenov, Renat
  • Foix, Sergi
  • Borràs, Julia
  • Castorani, Vincenzo
  • Longhi, Sauro
  • Bonci, Andrea
This paper explores the issue of protective film removal in the hand layup process for composite parts production. The hand layup process, involving the assembly of prepreg plies onto a mold, is a skill-intensive task performed by multiple expert workers. A significant limitation of this method is its low repeatability, which impacts both the consistency and quality of the final product. The current research trend has the objective of developing autonomous or semi-autonomous layup cells to enhance process consistency, reduce production costs, and improve product quality. Despite all this interest in bringing automation in composite manufacturing, an area left relatively unexplored is the removal of protective films from prepregs. The plies used in the hand layup process, are generally covered by those films that are removed by the workers during the manual layup activity. The manual removal of protective films from prepregs is a tedious and valueless task, which represents a bottleneck in achieving full or semi-automation of the layup process. For this reason, an autonomous or semi-autonomous cell needs to perform it to be market-relevant. In this work, we propose a new effective method for initiating the peeling and integrate this method into a complete framework for the removal of protective films. This solution is designed to be easily integrated into a variety of existing cells. Finally, we validate our framework with an experimental proof of concept (PoC) which makes use of two collaborative robots for task execution., This research was partially funded by European project Horizon Europe “EDIH4Marche” (European Digital Innovation Hub for Marche), Call DIGITAL-2021-EDIH-01, Grant Agreement no. 101084027 on topic DIGITAL-2021-EDIH-INITIAL-01 (DIGITAL Simple Grants Acton) and project CHLOE-GRAPH (PID2020-118649RB-I00) funded by Ministerio de Ciencia, Innovación y Universidades/Spanish State Research Agency (AEI) /10.13039/501100011033., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Inside-out states of garments

  • Jiménez Schlegl, Pablo
IRI-TR-24-01, Cloth items such as garments can be potentially in in nite di erent con gurations, due to their deformability. For the practical purposes of manipulation, however, it is possible to discretize the space of deformations into a set of equivalent states. This is pursued in the present work, where the complex problem of recovering the canonical con guration of partially (or completely) reversed garments is addressed. Without claiming to solve the hard perceptual and manipulative challenges of this type of task {which are also thoroughly described{, this work should rather be viewed as a pioneering e ort to formalize the high-level strategies that aim at solving this canonical con guration-recovering task., This work has been partially funded by the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE), Project ROB-IN PLEC2021-007859 funded by MCIN/ AEI /10.13039/501100011033 and by the "European Union NextGenerationEU/ PRTR" and Project CHLOE-Graph PID2020-118649RB-I00 funded by MCIN/ AEI /10.13039/501100011033, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Tracking cloth deformation: A novel dataset for closing the sim-to-real gap for robotic cloth manipulation learning

  • Coltraro, Franco
  • Borràs, Julia
  • Alberich-Carramiñana, Maria
  • Torras, Carme
Robotic learning for deformable object manipulation—such as textiles—is often done in simulation due to the current limitation of perception methods to understand cloth’s deformation. For this reason, the robotics community is always on the search for more realistic simulators to reduce as much as possible the sim-to-real gap, which is still quite large especially when dynamic motions are applied. We present a cloth dataset consisting of 120 high-quality recordings of several textiles during dynamic motions. Using a Motion Capture System, we record the location of key-points on the cloth surface of four types of fabrics (cotton, denim, wool and polyester) of two sizes and at different speeds. The scenarios considered are all dynamic and involve rapid shaking and twisting of the textiles, collisions with frictional objects, strong hits with a long and thin rigid object and even self-collisions. We explain in detail the scenarios considered, the collected data and how to read it and use it. In addition, we propose a metric to use the dataset as a benchmark to quantify the sim-to-real gap of any cloth simulator. Finally, we show that the recorded trajectories can be directly executed by a robotic arm, enabling learning by demonstration and other imitation learning techniques.Dataset: https://doi.org/10.5281/zenodo.14644526Video: https://fcoltraro.github.io/projects/dataset/, This work was supported by the Consejo Superior de Investigaciones Científicas (Momentum project MMT24-IRII-01 and ClothIRI: CSIC project 202350E080), Agència de Gestió d’Ajuts Universitaris i de Recerca (2021 SGR 00603 Geometry of Manifolds and Applications and SGR RobIRI 2021 SGR 00514), Agencia Estatal de Investigación (AEI/10.13039/501100011033 grant PID2019-103849GB-I) and (PID2020-118649RB-I00(CHLOE-GRAPH) funded by MCINAEI)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Representació dels estats d’una tela basada en la derivada de la integral d’enllaç de Gauss

  • Coltraro, Franco
  • Fontana, Josep
  • Alberich-Carramiñana, Maria
  • Borràs, Julia
  • Torras, Carme
La manipulació robòtica de teles és una tasca complexa a causa de l’espai d’estats de forma d’infinites dimensions dels tèxtils, que dificulta molt la percepció dels estats. En aquest article introduïm les coordenades de tela dGLI, una representació de dimensió baixa dels estats d’una tela que ens permet distingir de manera eficient una gran varietat d’estats de plegament, fet que obre les portes a mètodes d’aprenentatge eficients per a la planificació i el control de la manipulació de teles. La representació es basa en una derivada direccional de la integral d’enllaç de Gauss i ens permet representar configuracions de plegament espacials i planàries de manera consistent i unificada. Es comprova que les coordenades de tela dGLI que proposem són més encertades en la representació dels estats de la tela i significativament més sensibles als canvis en possibilitats de prensió que altres mètodes clàssics de distància de formes. Per acabar, apliquem la representació a imatges reals d’una tela i es demostra que permet identificar els diferents estats utilitzant un classificador basat en la distància., Aquest estudi es va fer dins del projecte CLOTHILDE, que ha rebut finançament del Consell Europeu de Recerca (ERC) dins del programa de recerca i innovació de la UE Horitzó 2020 (acord de subvenció núm. 741930). M. Alberich-Carramiñana també està afiliada a la BarcelonaGraduate School of Mathematics (BGSMath) i a l’Institut de Matemàtiques de la UPC-BarcelonaTech (IMTech), i tant ella com J. Amorós estan finançats parcialment per l’Agència Estatal d’Investigació espanyola AEI/10.13039/501100011033 subvenció PID2019-103849GB-I00 i pel pro-jecte AGAUR 2021 SGR 00603 Geometry of Manifolds and Applications, GEOMVAP. J. Borràs està finançada per l’Agència Estatal d’Investigació espanyola MCIN/AEI/10.13039/501100011033 subvenció PID2020-118649RB-I00 (projecte CHLOE-GRAPH), Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Generating predicate suggestions based on the space of plans: an example of planning with preferences

  • Canal Camprodon, Gerard|||0000-0002-6718-1198
  • Torras, Carme|||0000-0002-2933-398X
  • Alenyà Ribas, Guillem|||0000-0002-6018-154X
The version of record is available online at: https://dx.doi.org/10.1007/s11257-022-09327-w, Task planning in human–robot environments tends to be particularly complex as it involves additional uncertainty introduced by the human user. Several plans, entailing few or various differences, can be obtained to solve the same given task. To choose among them, the usual least-cost plan criteria is not necessarily the best option, because here, human constraints and preferences come into play. Knowing these user preferences is very valuable to select an appropriate plan, but the preference values are usually hard to obtain. In this context, we propose the Space-of-Plans-based Suggestions (SoPS) algorithms that can provide suggestions for some planning predicates, which are used to define the state of the environment in a task planning problem where actions modify the predicates. We denote these predicates as suggestible predicates, of which user preferences are a particular case. The first algorithm is able to analyze the potential effect of the unknown predicates and provide suggestions to values for these unknown predicates that may produce better plans. The second algorithm is able to suggest changes to already known values that potentially improve the obtained reward. The proposed approach utilizes a Space of Plans Tree structure to represent a subset of the space of plans. The tree is traversed to find the predicates and the values that would most increase the reward, and output them as a suggestion to the user. Our evaluation in three preference-based assistive robotics domains shows how the proposed algorithms can improve task performance by suggesting the most effective predicate values first., This work has been partially supported by the ERC project Clothilde (ERC-2016-ADG-741930); by MCIN/AEI/10.13039/501100011033 under the project CHLOE-GRAPH (PID2020-118649RB-l00); by the European Union NextGenerationEU/PRTR under the project ROB-IN (PLEC2021-007859); and by the CHIST-ERA project COHERENT (EPSRC EP/V062506/1), Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Fitting parameters of linear dynamical systems to regularize forcing terms in dynamical movement primitives

  • Stulp, Freek
  • Colomé Figueras, Adrià|||0000-0001-9715-4062
  • Torras, Carme|||0000-0002-2933-398X
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Due to their flexibility and ease of use, Dynamical Movement Primitives (DMPs) are widely used in robotics applications and research. DMPs combine linear dynamical systems to achieve robustness to perturbations and adaptation to moving targets with non-linear function approximators to fit a wide range of demonstrated trajectories. We propose a novel DMP formulation with a generalized logistic function as a delayed goal system. This formulation inherently has low initial jerk, and generates the bell-shaped velocity profiles that are typical of human movement. As the novel formulation is more expressive, it is able to fit a wide range of human demonstrations well, also without a non-linear forcing term. We exploit this increased expressiveness by automating the fitting of the dynamical system parameters through optimization. Our experimental evaluation demonstrates that this optimization regularizes the forcing term, and improves the interpolation accuracy of parametric DMPs., This work was partially funded by the European ERC/EIC/Horizon projects with grant numbers 741930 (CLOTHILDE), 951992 (VeriDream), and 101070596 (euROBIN), as well the CSIC project 202350E080 (ClothIRI), and the MCIN/AEI project PID2020-118649RBI00 (CHLOE-GRAPH)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

Inside-out states of garments, Technical report IRI-TR-24-01

  • Jiménez Schlegl, Pablo|||0000-0003-3627-4938
Cloth items such as garments can be potentially in infinite different configurations, due to their deformability. For the practical purposes of manipulation, however, it is possible to discretize the space of deformations into a set of equivalent states. This is pursued in the present work, where the complex problem of recovering the canonical configuration of partially (or completely) reversed garments is addressed. Without claiming to solve the hard perceptual and manipulative challenges of this type of task –which are also thoroughly described–, this work should rather be viewed as a pioneering effort to formalize the high-level strategies that aim at solving this canonical configuration-recovering task., Cloth items such as garments can be potentially in infinite different configurations, due to their deformability. For the practical purposes of manipulation, however, it is possible to discretize the space of deformations into a set of equivalent states. This is pursued in the present work, where the complex problem of recovering the canonical configuration of partially (or completely) reversed garments is addressed. Without claiming to solve the hard perceptual and manipulative challenges of this type of task –which are also thoroughly described–, this work should rather be viewed as a pioneering effort to formalize the high-level strategies that aim at solving this canonical configuration-recovering task., This work has been partially funded by the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE), Project ROB-IN PLEC2021-007859 funded by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR” and Project CHLOE-Graph PID2020-118649RB-I00 funded by MCIN/AEI /10.13039/501100011033
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Tracking cloth deformation: a novel dataset for closing the sim-to-real gap for robotic cloth manipulation learning

  • Coltraro, Franco|||0000-0002-9149-950X
  • Borràs Sol, Júlia|||0000-0002-1662-2037
  • Alberich Carramiñana, Maria|||0000-0003-2749-4875
  • Torras, Carme|||0000-0002-2933-398X
Robotic learning for deformable object manipulation—such as textiles—is often done in simulation due to the current limitation of perception methods to understand cloth’s deformation. For this reason, the robotics community is always on the search for more realistic simulators to reduce as much as possible the sim-to-real gap, which is still quite large especially when dynamic motions are applied. We present a cloth dataset consisting of 120 high-quality recordings of several textiles during dynamic motions. Using a Motion Capture System, we record the location of key-points on the cloth surface of four types of fabrics (cotton, denim, wool and polyester) of two sizes and at different speeds. The scenarios considered are all dynamic and involve rapid shaking and twisting of the textiles, collisions with frictional objects, strong hits with a long and thin rigid object and even self-collisions. We explain in detail the scenarios considered, the collected data and how to read it and use it. In addition, we propose a metric to use the dataset as a benchmark to quantify the sim-to-real gap of any cloth simulator. Finally, we show that the recorded trajectories can be directly executed by a robotic arm, enabling learning by demonstration and other imitation learning techniques., The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Consejo Superior de Investigaciones Científicas (Momentum project MMT24-IRII-01 and ClothIRI: CSIC project 202350E080), Agència de Gestió d’Ajuts Universitaris i de Recerca (2021 SGR 00603 Geometry of Manifolds and Applications and SGR RobIRI 2021 SGR 00514), Agencia Estatal de Investigación (AEI/10.13039/501100011033 grant PID2019-103849GB-I) and (PID2020-118649RB-I00(CHLOE-GRAPH) funded by MCINAEI)., Peer Reviewed, 9 - Indústria, Innovació i Infraestructura
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A representation of cloth states based on a derivative of the Gauss linking integral

  • Coltraro, Franco|||0000-0002-9149-950X
  • Fontana, Josep
  • Amorós Torrent, Jaume|||0000-0002-3133-9985
  • Alberich Carramiñana, Maria|||0000-0003-2749-4875
  • Borràs Sol, Júlia|||0000-0002-1662-2037
  • Torras, Carme|||0000-0002-2933-398X
Robotic manipulation of cloth is a complex task because of the infinite-dimensional shape-state space of textiles, which makes their state estimation very difficult. In this paper we introduce the dGLI Cloth Coordinates, a finite low-dimensional representation of cloth states that allows us to efficiently distinguish a large variety of different folded states, opening the door to efficient learning methods for cloth manipulation planning and control. Our representation is based on a directional derivative of the Gauss Linking Integral and allows us to represent spatial as well as planar folded configurations in a consistent and unified way. The proposed dGLI Cloth Coordinates are shown to be more accurate in the representation of cloth states and significantly more sensitive to changes in grasping affordances than other classic shape distance methods. Finally, we apply our representation to real images of a cloth, showing that with it we can identify the different states using a distance-based classifier., This work was developed under the project CLOTHILDE which has received funding from the European Research Council (ERC) under the EU-Horizon 2020 research and innovation programme (grant agreement No. 741930). M. Alberich-Carramiñana is also with the Barcelona Graduate School of Mathematics (BGSMath) and the Institut de Matemàtiques de la UPC-BarcelonaTech (IMTech), and she and J. Amorós are partially supported by the Spanish State Research Agency AEI/10.13039/501100011033 grant PID2019-103849GB-I00 and by the AGAUR project 2021 SGR 00603 Geometry of Manifolds and Applications, GEOMVAP. J. Borràs is supported by the Spanish State Research Agency MCIN/ AEI /10.13039/501100011033 grant PID2020-118649RB-I00 (CHLOE-GRAPH project)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Automating the hand layup process: on the removal of protective films with collaborative robots

  • Kermenov, Renat|||0000-0002-8985-9510
  • Foix Salmerón, Sergi|||0000-0001-9249-6696
  • Borràs Sol, Júlia|||0000-0002-1662-2037
  • Castorani, Vincenzo
  • Longhi, Sauro
  • Bonci, Andrea
This paper explores the issue of protective film removal in the hand layup process for composite parts production. The hand layup process, involving the assembly of prepreg plies onto a mold, is a skill-intensive task performed by multiple expert workers. A significant limitation of this method is its low repeatability, which impacts both the consistency and quality of the final product. The current research trend has the objective of developing autonomous or semi-autonomous layup cells to enhance process consistency, reduce production costs, and improve product quality. Despite all this interest in bringing automation in composite manufacturing, an area left relatively unexplored is the removal of protective films from prepregs. The plies used in the hand layup process, are generally covered by those films that are removed by the workers during the manual layup activity. The manual removal of protective films from prepregs is a tedious and valueless task, which represents a bottleneck in achieving full or semi-automation of the layup process. For this reason, an autonomous or semi-autonomous cell needs to perform it to be market-relevant. In this work, we propose a new effective method for initiating the peeling and integrate this method into a complete framework for the removal of protective films. This solution is designed to be easily integrated into a variety of existing cells. Finally, we validate our framework with an experimental proof of concept (PoC) which makes use of two collaborative robots for task execution., This research was partially funded by European project Horizon Europe ‘‘EDIH4Marche’’ (European Digital Innovation Hub for Marche), Call DIGITAL-2021-EDIH-01, Grant Agreement no. 101084027 on topic DIGITAL-2021-EDIH-INITIAL-01 (DIGITAL Simple Grants Acton) and project CHLOE-GRAPH (PID2020-118649RB-I00) funded by Ministerio de Ciencia, Innovación y Universidades/Spanish State Research Agency (AEI) /10.13039/501100011033., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Representació dels estats d’una tela basada en la derivada de la integral d’enllaç de Gauss

  • Coltraro, Franco|||0000-0002-9149-950X
  • Fontana, Josep
  • Alberich Carramiñana, Maria|||0000-0003-2749-4875
  • Borràs Sol, Júlia|||0000-0002-1662-2037
  • Torras, Carme|||0000-0002-2933-398X
La manipulació robòtica de teles és una tasca complexa a causa de l’espai d’estats de forma d’infinites dimensions dels tèxtils, que dificulta molt la percepció dels estats. En aquest article introduïm les coordenades de tela dGLI, una representació de dimensió baixa dels estats d’una tela que ens permet distingir de manera eficient una gran varietat d’estats de plegament, fet que obre les portes a mètodes d’aprenentatge eficients per a la planificació i el control de la manipulació de teles. La representació es basa en una derivada direccional de la integral d’enllaç de Gauss i ens permet representar configuracions de plegament espacials i planàries de manera consistent i unificada. Es comprova que les coordenades de tela dGLI que proposem són més encertades en la representació dels estats de la tela i significativament més sensibles als canvis en possibilitats de prensió que altres mètodes clàssics de distància de formes. Per acabar, apliquem la representació a imatges reals d’una tela i es demostra que permet identificar els diferents estats utilitzant un classificador basat en la distància., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Ontological modeling and reasoning for comparison and contrastive narration of robot plans

  • Olivares Alarcos, Alberto|||0000-0002-7733-7715
  • Foix, Sergi
  • Borràs Sol, Júlia|||0000-0002-1662-2037
  • Canal Camprodon, Gerard|||0000-0002-6718-1198
  • Alenyà Ribas, Guillem|||0000-0002-6018-154X
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Ontological modeling and reasoning for comparison and contrastive narration of robot plans

  • Olivares Alarcos, Alberto
  • Foix, Sergi
  • Borràs Sol, Júlia
  • Canal Camprodon, Gerard
  • Alenyà Ribas, Guillem
This extended abstract focuses on an approach to modeling and reasoning about the comparison of competing plans, so that robots can later explain the divergent result. First, the need for a novel ontological model that empowers robots to formalize and reason about plan divergences is identified. Then, a new ontological theory is proposed to facilitate the classification of plans (e.g., the shortest, the safest, the closest to human preferences, etc.). Finally, the limitations of a baseline algorithm for ontology-based explanatory narration are examined, and a novel algorithm is introduced to leverage the divergent knowledge between plans, enabling the construction of contrastive narratives. An empirical evaluation is conducted to assess the quality of the explanations provided by the proposed algorithm, which outperforms the baseline method., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Tracking cloth deformation: a novel dataset for closing the sim-to-real gap for robotic cloth manipulation learning

  • Coltraro, Franco
  • Borràs Sol, Júlia
  • Alberich Carramiñana, Maria
  • Torras, Carme
Robotic learning for deformable object manipulation—such as textiles—is often done in simulation due to the current limitation of perception methods to understand cloth’s deformation. For this reason, the robotics community is always on the search for more realistic simulators to reduce as much as possible the sim-to-real gap, which is still quite large especially when dynamic motions are applied. We present a cloth dataset consisting of 120 high-quality recordings of several textiles during dynamic motions. Using a Motion Capture System, we record the location of key-points on the cloth surface of four types of fabrics (cotton, denim, wool and polyester) of two sizes and at different speeds. The scenarios considered are all dynamic and involve rapid shaking and twisting of the textiles, collisions with frictional objects, strong hits with a long and thin rigid object and even self-collisions. We explain in detail the scenarios considered, the collected data and how to read it and use it. In addition, we propose a metric to use the dataset as a benchmark to quantify the sim-to-real gap of any cloth simulator. Finally, we show that the recorded trajectories can be directly executed by a robotic arm, enabling learning by demonstration and other imitation learning techniques., The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Consejo Superior de Investigaciones Científicas (Momentum project MMT24-IRII-01 and ClothIRI: CSIC project 202350E080), Agència de Gestió d’Ajuts Universitaris i de Recerca (2021 SGR 00603 Geometry of Manifolds and Applications and SGR RobIRI 2021 SGR 00514), Agencia Estatal de Investigación (AEI/10.13039/501100011033 grant PID2019-103849GB-I) and (PID2020-118649RB-I00(CHLOE-GRAPH) funded by MCINAEI)., Peer Reviewed, 9 - Indústria, Innovació i Infraestructura, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Fitting parameters of linear dynamical systems to regularize forcing terms in dynamical movement primitives

  • Stulp, Freek
  • Colomé Figueras, Adrià
  • Torras, Carme
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Due to their flexibility and ease of use, Dynamical Movement Primitives (DMPs) are widely used in robotics applications and research. DMPs combine linear dynamical systems to achieve robustness to perturbations and adaptation to moving targets with non-linear function approximators to fit a wide range of demonstrated trajectories. We propose a novel DMP formulation with a generalized logistic function as a delayed goal system. This formulation inherently has low initial jerk, and generates the bell-shaped velocity profiles that are typical of human movement. As the novel formulation is more expressive, it is able to fit a wide range of human demonstrations well, also without a non-linear forcing term. We exploit this increased expressiveness by automating the fitting of the dynamical system parameters through optimization. Our experimental evaluation demonstrates that this optimization regularizes the forcing term, and improves the interpolation accuracy of parametric DMPs., This work was partially funded by the European ERC/EIC/Horizon projects with grant numbers 741930 (CLOTHILDE), 951992 (VeriDream), and 101070596 (euROBIN), as well the CSIC project 202350E080 (ClothIRI), and the MCIN/AEI project PID2020-118649RBI00 (CHLOE-GRAPH)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Representació dels estats d’una tela basada en la derivada de la integral d’enllaç de Gauss

  • Coltraro, Franco
  • Fontana, Josep
  • Alberich Carramiñana, Maria
  • Borràs Sol, Júlia
  • Torras, Carme
La manipulació robòtica de teles és una tasca complexa a causa de l’espai d’estats de forma d’infinites dimensions dels tèxtils, que dificulta molt la percepció dels estats. En aquest article introduïm les coordenades de tela dGLI, una representació de dimensió baixa dels estats d’una tela que ens permet distingir de manera eficient una gran varietat d’estats de plegament, fet que obre les portes a mètodes d’aprenentatge eficients per a la planificació i el control de la manipulació de teles. La representació es basa en una derivada direccional de la integral d’enllaç de Gauss i ens permet representar configuracions de plegament espacials i planàries de manera consistent i unificada. Es comprova que les coordenades de tela dGLI que proposem són més encertades en la representació dels estats de la tela i significativament més sensibles als canvis en possibilitats de prensió que altres mètodes clàssics de distància de formes. Per acabar, apliquem la representació a imatges reals d’una tela i es demostra que permet identificar els diferents estats utilitzant un classificador basat en la distància., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Generating predicate suggestions based on the space of plans: an example of planning with preferences

  • Canal Camprodon, Gerard
  • Torras, Carme
  • Alenyà Ribas, Guillem
The version of record is available online at: https://dx.doi.org/10.1007/s11257-022-09327-w, Task planning in human–robot environments tends to be particularly complex as it involves additional uncertainty introduced by the human user. Several plans, entailing few or various differences, can be obtained to solve the same given task. To choose among them, the usual least-cost plan criteria is not necessarily the best option, because here, human constraints and preferences come into play. Knowing these user preferences is very valuable to select an appropriate plan, but the preference values are usually hard to obtain. In this context, we propose the Space-of-Plans-based Suggestions (SoPS) algorithms that can provide suggestions for some planning predicates, which are used to define the state of the environment in a task planning problem where actions modify the predicates. We denote these predicates as suggestible predicates, of which user preferences are a particular case. The first algorithm is able to analyze the potential effect of the unknown predicates and provide suggestions to values for these unknown predicates that may produce better plans. The second algorithm is able to suggest changes to already known values that potentially improve the obtained reward. The proposed approach utilizes a Space of Plans Tree structure to represent a subset of the space of plans. The tree is traversed to find the predicates and the values that would most increase the reward, and output them as a suggestion to the user. Our evaluation in three preference-based assistive robotics domains shows how the proposed algorithms can improve task performance by suggesting the most effective predicate values first., This work has been partially supported by the ERC project Clothilde (ERC-2016-ADG-741930); by MCIN/AEI/10.13039/501100011033 under the project CHLOE-GRAPH (PID2020-118649RB-l00); by the European Union NextGenerationEU/PRTR under the project ROB-IN (PLEC2021-007859); and by the CHIST-ERA project COHERENT (EPSRC EP/V062506/1), Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A representation of cloth states based on a derivative of the Gauss linking integral

  • Coltraro, Franco
  • Fontana, Josep
  • Amorós Torrent, Jaume
  • Alberich Carramiñana, Maria
  • Borràs Sol, Júlia
  • Torras, Carme
Robotic manipulation of cloth is a complex task because of the infinite-dimensional shape-state space of textiles, which makes their state estimation very difficult. In this paper we introduce the dGLI Cloth Coordinates, a finite low-dimensional representation of cloth states that allows us to efficiently distinguish a large variety of different folded states, opening the door to efficient learning methods for cloth manipulation planning and control. Our representation is based on a directional derivative of the Gauss Linking Integral and allows us to represent spatial as well as planar folded configurations in a consistent and unified way. The proposed dGLI Cloth Coordinates are shown to be more accurate in the representation of cloth states and significantly more sensitive to changes in grasping affordances than other classic shape distance methods. Finally, we apply our representation to real images of a cloth, showing that with it we can identify the different states using a distance-based classifier., This work was developed under the project CLOTHILDE which has received funding from the European Research Council (ERC) under the EU-Horizon 2020 research and innovation programme (grant agreement No. 741930). M. Alberich-Carramiñana is also with the Barcelona Graduate School of Mathematics (BGSMath) and the Institut de Matemàtiques de la UPC-BarcelonaTech (IMTech), and she and J. Amorós are partially supported by the Spanish State Research Agency AEI/10.13039/501100011033 grant PID2019-103849GB-I00 and by the AGAUR project 2021 SGR 00603 Geometry of Manifolds and Applications, GEOMVAP. J. Borràs is supported by the Spanish State Research Agency MCIN/ AEI /10.13039/501100011033 grant PID2020-118649RB-I00 (CHLOE-GRAPH project)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Automating the hand layup process: on the removal of protective films with collaborative robots

  • Kermenov, Renat
  • Foix Salmerón, Sergi
  • Borràs Sol, Júlia
  • Castorani, Vincenzo
  • Longhi, Sauro
  • Bonci, Andrea
This paper explores the issue of protective film removal in the hand layup process for composite parts production. The hand layup process, involving the assembly of prepreg plies onto a mold, is a skill-intensive task performed by multiple expert workers. A significant limitation of this method is its low repeatability, which impacts both the consistency and quality of the final product. The current research trend has the objective of developing autonomous or semi-autonomous layup cells to enhance process consistency, reduce production costs, and improve product quality. Despite all this interest in bringing automation in composite manufacturing, an area left relatively unexplored is the removal of protective films from prepregs. The plies used in the hand layup process, are generally covered by those films that are removed by the workers during the manual layup activity. The manual removal of protective films from prepregs is a tedious and valueless task, which represents a bottleneck in achieving full or semi-automation of the layup process. For this reason, an autonomous or semi-autonomous cell needs to perform it to be market-relevant. In this work, we propose a new effective method for initiating the peeling and integrate this method into a complete framework for the removal of protective films. This solution is designed to be easily integrated into a variety of existing cells. Finally, we validate our framework with an experimental proof of concept (PoC) which makes use of two collaborative robots for task execution., This research was partially funded by European project Horizon Europe ‘‘EDIH4Marche’’ (European Digital Innovation Hub for Marche), Call DIGITAL-2021-EDIH-01, Grant Agreement no. 101084027 on topic DIGITAL-2021-EDIH-INITIAL-01 (DIGITAL Simple Grants Acton) and project CHLOE-GRAPH (PID2020-118649RB-I00) funded by Ministerio de Ciencia, Innovación y Universidades/Spanish State Research Agency (AEI) /10.13039/501100011033., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

Inside-out states of garments, Technical report IRI-TR-24-01

  • Jiménez Schlegl, Pablo
Cloth items such as garments can be potentially in infinite different configurations, due to their deformability. For the practical purposes of manipulation, however, it is possible to discretize the space of deformations into a set of equivalent states. This is pursued in the present work, where the complex problem of recovering the canonical configuration of partially (or completely) reversed garments is addressed. Without claiming to solve the hard perceptual and manipulative challenges of this type of task –which are also thoroughly described–, this work should rather be viewed as a pioneering effort to formalize the high-level strategies that aim at solving this canonical configuration-recovering task., Cloth items such as garments can be potentially in infinite different configurations, due to their deformability. For the practical purposes of manipulation, however, it is possible to discretize the space of deformations into a set of equivalent states. This is pursued in the present work, where the complex problem of recovering the canonical configuration of partially (or completely) reversed garments is addressed. Without claiming to solve the hard perceptual and manipulative challenges of this type of task –which are also thoroughly described–, this work should rather be viewed as a pioneering effort to formalize the high-level strategies that aim at solving this canonical configuration-recovering task., This work has been partially funded by the European Union Horizon 2020 Programme under grant agreement no. 741930 (CLOTHILDE), Project ROB-IN PLEC2021-007859 funded by MCIN/ AEI /10.13039/501100011033 and by the ”European Union NextGenerationEU/PRTR” and Project CHLOE-Graph PID2020-118649RB-I00 funded by MCIN/AEI /10.13039/501100011033, Preprint