Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 3
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Mobile robotic platforms for the acoustic tracking of deep-sea demersal fishery resources

  • Masmitja, Ivan
  • Navarro, Joan
  • Gomáriz, Spartacus
  • Aguzzi, Jacopo
  • Kieft, Brian
  • O'Reilly, Tom
  • Katija, Kakani
  • Bouvet, P.J.
  • Fannjiang, Clara
  • Vigo Fernandez, María
  • Puig, Pere
  • Alcocer, A.
  • Vallicrosa, Guillem
  • Palomeras, Narcís
  • Carreras, Marc
  • Río, Joaquín del
  • Company, Joan B.
15 pages, 6 figures, 2 tables, supplementary material https://doi.org/10.1126/scirobotics.abc3701.-- This manuscript has been accepted for publication in Science Robotics. This version has not undergone final editing. Please refer to the complete version of record at https://robotics.sciencemag.org/content/5/48/eabc3701. The manuscript may not be reproduced or used in any manner that does not fall within the fair use provisions of the Copyright Act without the prior, written permission of AAAS, Knowing the displacement capacity and mobility patterns of industrially exploited (i.e., fished) marine resources is key to establishing effective conservation management strategies in human-impacted marine ecosystems. Acquiring accurate behavioral information of deep-sea fished ecosystems is necessary to establish the sizes of marine protected areas within the framework of large international societal programs (e.g., European Community H2020, as part of the Blue Growth economic strategy). However, such information is currently scarce, and high-frequency and prolonged data collection is rarely available. Here, we report the implementation of autonomous underwater vehicles and remotely operated vehicles as an aid for acoustic long-baseline localization systems for autonomous tracking of Norway lobster (Nephrops norvegicus), one of the key living resources exploited in European waters. In combination with seafloor moored acoustic receivers, we detected and tracked the movements of 33 tagged lobsters at 400-m depth for more than 3 months. We also identified the best procedures to localize both the acoustic receivers and the tagged lobsters, based on algorithms designed for off-the-shelf acoustic tags identification. Autonomous mobile platforms that deliver data on animal behavior beyond traditional fixed platform capabilities represent an advance for prolonged, in situ monitoring of deep-sea benthic animal behavior at meter spatial scales, This work received financial support from different research projects of the Spanish Ministerio de Economía y Competitividad (RESNEP: CTM2017-82991-C2-1-R; RESBIO: TEC2017-87861-R; and SASES: RTI2018-095112-B-I00), of the Generalitat de Catalunya “Sistemas de Adquisición Remota de datos y Tratamiento de la Información en el Medio Marino (SARTI-MAR)” 2017 SGR 371, and NSF-IDBR (#145501 to K.K.). J.N. was funded by the Spanish National Program Ramón y Cajal (RYC-2015-17809). This project has also received support from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie–Individual Fellowship grant agreement AIforUTracking No. 893089, With the funding support of the ‘Severo Ochoa Centre of Excellence’ accreditation (CEX2019-000928-S), of the Spanish Research Agency (AEI)
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Developing an acoustic tag with bidirectional communications capabilities

  • Masmitja, Ivan
  • Gomáriz, Spartacus
  • Bouvet, P.J.
  • Aguzzi, Jacopo
  • Río, Joaquín del
Special issue 9th MARTECH: International Workshop on Marine Technology: 16-18 June 2021, Vigo, Spain.-- 2 pages, 3 figures, The study of marine animal behavior is crucial to manage fisheries stocks and to understand the climate change effect on them, especially their moving patterns. In order to achieve that, different methods have been developed during the last years, specially using acoustic tags. However, all the tags available nowadays are transmitters, and therefore, can only be used as a ¿listen method¿. Here, we present a new acoustic tag with bidirectional communications capabilities (i.e. can transmit and also receive acoustic signals). This approach will allow the possibility to use new techniques to study marine animals (e.g. range-only and singe-beacon methods with autonomous vehicles), and therefore, increase the knowledge of their behaviour, This work received financial support from the Spanish Ministerio de Economia y Competitividad (contract TEC2017-87861-R project RESBIO, and RTI2018-095112-B-I00 project SASES), and from the Generalitat de Catalunya "Sistemas de Adquisición Remota de datos y Tratamiento de la Información en el Medio Marino (SARTI-MAR)" 2017 SGR 371. This work has been directed and carried out by members of the Tecnoterra-associated unit of the Scientific Research Council through the Universitat Politècnica de Catalunya, the Jaume Almera Earth Sciences Institute and the Marine Science Institute. IM was funded by a MSCA-IF-GF (ID:893089, H2020-EU.1.3.2, European Commission)
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

TransfQMix: Transformers for Leveraging the Graph Structure of Multi-Agent Reinforcement Learning Problems

  • Gallici, Matteo
  • Martin, Mario
  • Masmitja, Ivan
International Conference on Autonomous Agents and Multiagent Systems (AAMAS '23), 29 May - 2 June 2023, London, United Kingdom.-- 9 pages, 6 figures, 1 table, supplementary material, Coordination is one of the most difficult aspects of multi-agent reinforcement learning (MARL). One reason is that agents normally choose their actions independently of one another. In order to see coordination strategies emerging from the combination of independent policies, the recent research has focused on the use of a centralized function (CF) that learns each agent's contribution to the team reward. However, the structure in which the environment is presented to the agents and to the CF is typically overlooked. We have observed that the features used to describe the coordination problem can be represented as vertex features of a latent graph structure. Here, we present TransfQMix, a new approach that uses transformers to leverage this latent structure and learn better coordination policies. Our transformer agents perform a graph reasoning over the state of the observable entities. Our transformer Q-mixer learns a monotonic mixing-function from a larger graph that includes the internal and external states of the agents. TransfQMix is designed to be entirely transferable, meaning that same parameters can be used to control and train larger or smaller teams of agents. This enables to deploy promising approaches to save training time and derive general policies in MARL, such as transfer learning, zero-shot transfer, and curriculum learning. We report TransfQMix's performances in the Spread and StarCraft II environments. In both settings, it outperforms state-of-the-art Q-Learning models, and it demonstrates effectiveness in solving problems that other methods can not solve, This project has received funding from the EU’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 893089. This work acknowledges the ‘Severo Ochoa Centre of Excellence’ accreditation (CEX2019-000928-S), Peer reviewed