Pasar al contenido principal

REPRESENTACION EN APRENDIZAJE CONTINUO Y ABIERTO EN ROBOTS INTELIGENTES

PID2021-126220OB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2021
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDADE DA CORUÑA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Understanding Joint Range of Motion Development in Robotic Learning

  • Naya-Varela, M.
  • Faíña, Andrés
  • Romero, Alejandro
  • Duro, Richard J.
[Abstract] Joint Range of Motion (JROM) development has been shown to facilitate learning motor control in human beings. This developmental strategy has been applied in robotics to improve learning performance with different outcomes: sometimes it is favourable, others irrelevant, and others, even detrimental. The reasons that underpin this variability in the results are still not well understood. In this paper, we seek to better understand the principles underlying the application of JROM based morphological development to make its use more straightforward. To this end, empirical studies were carried out over two representative use cases: quadruped and bipedal robot morphologies learning to walk. Different parameters of the application of JROM development (morphological configuration, JROM developmental strategy, etc.) have been evaluated to elucidate their effects over learning. The results show that there are significant connections between the reduction of the motor space induced by JROM and the way the exploration and exploitation of the solution space is carried out by the learning algorithm, and the performance achieved. Through these connections, we have identified a set of conditions that must be satisfied for JROM development to be effective as a tool for learning improvement., This research was partially funded by the European Union’s Horizon 2020, Research and Innovation Programme, GA 101070381 (“PILLAR-Robots - Purposeful Intrinsically-motivated Lifelong Learning Autonomous Robots”), by Xunta de Galicia (EDC431C-2021/39 and M. Naya-Varela’s grant ED481B), by the Spanish Science and Education Ministry (PID2021-126220OB-I00), and the Ministry for Digital Transformation and Civil Service and Next-Generation EU/RRF (TSI-100925-2023-1), by “ERDF A way of making Europe’, Centro de Investigación de Galicia “CITIC” (ED431G 2019/01)., Xunta de Galicia; EDC431C-2021/39, Xunta de Galicia; ED481B-2022-004, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Towards a Digital Twin for Open-Frame Underwater Vehicles Using Evolutionary Algorithms

  • Orjales, Félix
  • Rodríguez Cortegoso, Julián
  • Fernández-Pérez, Enrique
  • Romero, Alejandro
  • Díaz Casás, Vicente
[Abstract] Hydrodynamic coefficients determine the behavior of all simulated underwater vehicles. Therefore, it is essential to precisely define their values when aiming to replicate a real vehicle. Generally established procedures for obtaining them tend to have limitations, especially in transient responses. To address these issues, this paper proposes a comprehensive methodology for obtaining the hydrodynamic coefficients of an underwater vehicle. The main novelty is the combination of empirical measurements as a first step and evolutionary algorithms as a final step for optimizing the coefficients. The proposed methodology is described and applied to a commercially available remotely operated vehicle (ROV) BlueROV2, followed by analyzing the results in detail and including several tests that compare it to the real vehicle to validate its adequacy., This work has been partially funded by Grant TED2021-129847B-I00 by MCIN/AEI/10.13039/501100011033, by the “European Union NextGenerationEU/PRTR” and by the Xunta de Galicia ED431C 2021/39 program. This work has been partially funded by Grant PID2021-126220OB-I00 by MCIN/AEI/10.13039/501100011033 and by “ERDF A way of making Europe”, Xunta de Galicia; ED431C 2021/39
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Autonomous Generation of Sub-goals for Lifelong Learning in Robots

  • Fallas Hernández, Emanuel
  • Martínez-Alonso, Sergio
  • Romero, Alejandro
  • Becerra Permuy, José Antonio
  • Duro, Richard J.
The conference was held in Rome, Italy, from 30 June to 5 July 2025., [Abstract]: One of the challenges of open-ended learning in robots is the need to autonomously discover goals and learn skills to achieve them. However, when in lifelong learning settings, it is always desirable to generate sub-goals with their associated skills, without relying on explicit reward, as steppingstones to a goal. This allows sub-goals and skills to be reused to facilitate achieving other goals. This work proposes a two-pronged approach for sub-goal generation to address this challenge: a top-down approach, where sub-goals are hierarchically derived from general goals using intrinsic motivations to discover them, and a bottom-up approach, where sub-goal chains emerge from making latent relationships between goals and perceptual classes that were previously learned in different domains explicit. These methods help the robot to autonomously generate and chain sub-goals as a way to achieve more general goals. Additionally, they create more abstract representations of goals, helping to reduce sub-goal duplication and make the learning of skills more efficient. Implemented within an existing cognitive architecture for lifelong open-ended learning and tested with a real robot, our approach enhances the robot’s ability to discover and achieve goals, generate sub-goals in an efficient manner, generalize learned skills, and operate in dynamic and unknown environments without explicit intermediate rewards., This work was funded by the European Union’s Horizon 2020, research and innovation programme under GA 101070381 (PILLAR-Robots - Purposeful Intrinsically-motivated Lifelong Learning Autonomous Robots’), by Xunta de Galicia (EDC431C-2021/39), by the Spanish Science and Education Ministry (PID2021-126220OB-I00), and the Ministry for Digital Transformation and Civil Service and Next-Generation EU/RRF (TSI-100925-2023-1), by “ERDF A way of making Europe”, and Centro de Investigacion de Galicia “CITIC” (ED431G 2019/01)., Xunta de Galicia; EDC431C-2021/39, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Guiding the Exploration of the Solution Space in Walking Robots Through Growth-Based Morphological Development

  • Naya-Varela, M.
  • Duro, Richard J.
  • Faíña, Andrés
This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '23). Association for Computing Machinery, New York, NY, USA, 1230–1238. https://doi.org/10.1145/3583131.3590489., Included in: GECCO '23: Genetic and Evolutionary Computation Conference, Lisbon, Portugal July 15-19, 2023., [Abstract]: In human beings, the joint development of the body and cognitive system has been shown to facilitate the acquisition of new skills and abilities. In the literature, these natural principles have been applied to robotics with mixed results and different authors have suggested several hypotheses to explain them. One of the most popular hypotheses states that morphological development improves learning by increasing exploration of the solution space, avoiding stagnation in local optima. In this article, we are going to study the influence of growth-based morphological development and its nuances as a tool to improve the exploration of the solution space. We will perform a series of experiments over two different robot morphologies which learn to walk. Furthermore, we will compare these results to another optimization strategy that has been shown to be useful to favor exploration in learning algorithms: the application of noise during learning. Finally, to check if the increased exploration hypothesis holds, we visualize the genotypic space during learning considering the different optimization strategies by using the Search Trajectory Network representation. The results indicate that noise and growth increase exploration, but only growth guides the search towards good solutions., Research supported by the European Commission Horizon program PILLAR-Robots project, grant 101070381, the Xunta de Galicia and the European Regional Development Funds under grant EDC431C-2021/39, the Spanish Science and Education Ministry through grant PID2021-126220OB-100. M. Naya-Varela wish to acknowledge the support received by the Xunta de Galicia with his grant ED481B. We wish to acknowledge the support received from the Centro de Investigación "CITIC", funded by Xunta de Galicia and the European Union (European Regional Development Fund- Galicia 2014-2020 Program), by grant ED431G 2019/01 and the Centro de Supercomputación de Galicia (CESGA)., Xunta de Galicia; EDC431C-2021/39, Xunta de Galicia; ED481B, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Autonomous Discovery and Learning of Interdependent Goals in Non-Stationary Scenarios

  • Romero, Alejandro
  • Baldassarre, Gianluca
  • Duro, Richard J.
  • Santucci, Vieri Giuliano
Manuscrito aceptado, [Abstract] Developing artificial agents able to autonomously discover interesting states of the environment, set them as goals and learn the related skills and curricula is a paramount challenge for the deployment of robotic systems in real-world scenarios. Here robots must adapt to situations not foreseen at design-time and learn new skills eventually handling unexpected changes in the environment. In this work we present and test a cognitive architecture for robotic control, that integrates different features and mechanisms in a developmental perspective. In particular, we propose to treat goal-discovery as a specific motivation and allow the system to autonomously select it through a motivation selector. Moreover, we also propose to use intrinsic motivations (specifically the measure of competence) to let the system autonomously regulate its exploration in the learning of curricula of interrelated goals. The presented robotic experiments show the advantages of our approach in learning to achieve different goals with non-stationary interdependencies., This work was partially funded by MCIN/AEI/10.13039/501100011033 (PID2021-126220OB-I00), and by “ERDF A way of making Europe”, Xunta de Galicia (EDC431C-2021/39), Centro de Investigación de Galicia “CITIC” (ED431G 2019/01), and by the European Union’s Horizon 2020, research and innovation programme under GA 101070381 (‘PILLAR-Robots - Purposeful Intrinsically-motivated Lifelong Learning Autonomous Robots’)., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; EDC431C-2021/39
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Learning Adaptable Utility Models for Morphological Diversity

  • Campos-Alfaro, Francella
  • Jara, Carlos
  • Romero, Alejandro
  • Naya-Varela, M.
  • Duro, Richard J.
This version of the conference paper has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use (https://www.springernature.com/gp/open-science/policies/accepted-manuscript-terms), but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/978-3-031-61137-7_11., [Abstract]: This paper introduces an approach to the integration of open-ended learning in modular robotics. We aim to provide these robots, equipped with morphological adaptability, with the capability to autonomously learn utility models specific to each morphology, discovering objectives on their own through a motivational system designed for open-ended learning. This system incorporates intrinsic motivations based on novelty and introduces a unique intrinsic motivation based on frustration to prevent learning stagnation. Furthermore, the paper addresses the autonomous learning of world models, enabling the robot to identify its morphology, all within the framework of a cognitive architecture. Experimental results showcase the effectiveness of this approach in both real and simulated environments., This work was funded by the European Union’s Horizon 2020, research and innovation programme under GA 101070381 (‘PILLAR-Robots’), by MCIN (PID2021-126220OB-I00), by Xunta de Galicia (EDC431C-2021/39), and by the Xunta de Galicia (ED481B). Special thanks to the CESGA., Xunta de Galicia; EDC431C-2021/39, Xunta de Galicia; ED481B
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Using Perceptual Classes to Dream Policies in Open-Ended Learning Robotics

  • Romero, Alejandro
  • Meden, Blaz
  • Bellas, Francisco
  • Duro, Richard J.
[Abstract] Achieving Lifelong Open-ended Learning Autonomy (LOLA) is a key challenge in the field of robotics to advance to a new level of intelligent response. Robots should be capable of discovering goals and learn skills in specific domains that permit achieving the general objectives the designer establishes for them. In addition, robots should reuse previously learnt knowledge in different domains to facilitate learning and adaptation in new ones. To this end, cognitive architectures have arisen which encompass different components to support LOLA. A key feature of these architectures is to implement a proper balance between deliberative and reactive processes that allows for efficient real time operation and knowledge acquisition, but this is still an open issue. First, objectives must be defined in a domain-independent representation that allows for the autonomous determination of domain-dependent goals. Second, as no explicit reward function is available, a method to determine expected utility must also be developed. Finally, policy learning may happen in an internal deliberative scale (dreaming), so it is necessary to provide an efficient way to infer relevant and reliable data for dreaming to be meaningful. The first two aspects have already been addressed in the realm of the e-MDB cognitive architecture. For the third one, this work proposes Perceptual Classes (P-nodes) as a metacognitive structure that permits generating relevant “dreamt” data points that allow creating “imagined” trajectories for deliberative policy learning in a very efficient way. The proposed structure has been tested by means of an experiment with a real robot in LOLA settings, where it has been shown how policy dreaming is possible in such a challenging realm., This work was partially funded by MCIN/AEI/ 10.13039/501100011033 (grant PID2021-126220OB-I00) and by “ERDF A way of making Europe”, Xunta de Galicia (grant EDC431C-2021/39), Centro de Investigación de Galicia “CITIC” (grant ED431G 2019/01), and by Horizon Europe, GA 101070381 ‘PILLAR-Robots – Purposeful Intrinsically-motivated Lifelong Learning Autonomous Robots’., Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

An UAV System for Visual Inspection and Wall Thickness Measurements in Ship Surveys

  • López Peña, Fernando
  • Deibe Díaz, Álvaro
  • Orjales, Félix
  • Losada Pita, Javier
[Abstract] This article presents the development of a UAV system designed to perform visual inspections and thickness measurements in ships’ cargo tanks. That includes the conception and evolution of the different components and subsystems of this UAV system and several tests, including some carried out in actual operating conditions. It also presents a near-wall positioning and propulsion system designed and developed to improve stability and avoid collisions. The paper also describes an articulated arm designed around an EMAT probe for wall thickness measurement. The measurement chain developed for this purpose includes all the electronics and computing necessary to send data in real-time to a ground station. Flying near walls poses challenges that compromises accuracy when approaching each measurement target points. Therefore, the wall approach and departure flight maneuvers are fully automatic. That facilitates and speeds up the inspection task that may require measurements on thousands of locations specified by the surveyor. The proposed UAV system aims to automate and improve the long and expensive surveys and inspections in the marine industry by reducing their time and costs., The help and support of the Navantia Reparaciones shipyard in Ferrol, Spain is gratefully acknowledged. This work was funded by the European Union’s Horizon 2020, research and innovation programme under GA 101070381 (‘PILLAR-Robots’), by MCIN (PID2021-126220OB-I00) and Xunta de Galicia (EDC431C-2021/39), Xunta de Galicia; EDC431C-2021/39
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Towards Efficient Knowledge Reuse for Open-ended Learning in Real Robots through Motivation

  • Romero, Alejandro
  • Bellas, Francisco
  • Becerra Permuy, José Antonio
  • Duro, Richard J.
Manuscrito aceptado, [Abstract] The current work is focused on providing robotic systems with mechanisms that support lifelong open-ended learning, with the aim of increasing their real autonomy level. In this general scope, robots must discover their goals and learn the skills to achieve them in a priori unknown domains and tasks. Moreover, they must do it in way that allows this knowledge to be reused later to face new situations properly. To advance in this challenging field, this paper describes a specific motivation-based knowledge reuse strategy, together with the contextual processing carried out, within the e-MDB cognitive architecture. This strategy supports the reuse and adaptation of knowledge acquired in previously seen domains to new ones. It has been validated in a real-world experiment with the Baxter robot, which is analyzed and discussed here, that addresses open-ended interaction in a sequence of domains related to object manipulation., This work was partially funded by MCIN/AEI/10.13039/501100011033 (grant PID2021-126220OB-I00) and by “ERDF A way of making Europe”, Xunta de Galicia (grant EDC431C-2021/39), Centro de Investigación de Galicia “CITIC” (grant ED431G 2019/01), and by Horizon Europe, GA 101070381 “PILLAR-Robots - Purposeful Intrinsically-motivated Lifelong Learning Autonomous Robots'”., Xunta de Galicia; EDC431C-2021/39, Xunta de Galicia; ED431G 2019/01