Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 15
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Design, Implementation and Practical Energy-Efficiency Evaluation of a Blockchain Based Academic Credential Verification System for Low-Power Nodes

  • Fernández-Blanco, Gabriel
  • Froiz-Míguez, Iván
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
[Abstract]: The educational system manages extensive documentation and paperwork, which can lead to human errors and sometimes abuse or fraud, such as the falsification of diplomas, certificates or other credentials. In fact, in recent years, multiple cases of fraud have been detected, representing a significant cost to society, since fraud harms the trustworthiness of certificates and academic institutions. To tackle such an issue, this article proposes a solution aimed at recording and verifying academic records through a decentralized application that is supported by a smart contract deployed in the Ethereum blockchain and by a decentralized storage system based on Inter-Planetary File System (IPFS). The proposed solution is evaluated in terms of performance and energy efficiency, comparing the results obtained with a traditional Proof-of-Work (PoW) consensus protocol and the new Proof-of-Authority (PoA) protocol. The results shown in this paper indicate that the latter is clearly greener and demands less CPU load. Moreover, this article compares the performance of a traditional computer and two Single-Board Computers (SBCs) (a Raspberry Pi 4 and an Orange Pi One), showing that is possible to make use of the latter low-power devices to implement blockchain nodes but at the cost of higher response latency. Furthermore, the impact of Ethereum gas limit is evaluated, demonstrating its significant influence on the blockchain network performance. Thus, this article provides guidelines, useful practical evaluations and key findings that will help the next generation of green blockchain developers and researchers., This work has been funded by grant TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

EtherTuna: A Pseudo-Random Number Generator Oracle for Ethereum Networks Based on Fortuna

  • García-Cereijo, Pedro
  • Fernández-Blanco, Gabriel
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Presented at: 2024 6th International Conference on Blockchain Computing and Applications (BCCA), Dubai, United Arab Emirates. https://bcca-conference.org/2024/, This version of the article has been accepted for publication, after peer review. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The Version of Record is available online at: https://doi.org/10.1109/BCCA62388.2024.10844454, [Abstract]: The deterministic nature of blockchains presents a significant challenge to pseudo-random number generation. Conventional seed-based random number generation methods may not be suitable for deterministic environments as they may be predictable and susceptible to attacks. To address this challenge, this paper proposes the integration of a pseudorandom number generation oracle for the nodes of an Ethereum network. Such an oracle acts as an external provider of pseudorandom numbers, generating random data by using the Fortuna algorithm, which can be used by smart contracts and decentralized applications on the blockchain. However, the integration of an oracle raises additional security and reliability concerns as it relies on a central node that impairs the decentralization of the blockchain and depends on the ability of the oracle to provide unpredictable and non-tampered pseudo-random numbers. The presented implementation can be used in different sectors, such as games of chance, random selection and other scenarios where randomness is essential to guarantee fairness and security. Thus, the integration of a pseudo-random number generation oracle into a Ethereum network can significantly improve the functionality and security of such decentralized applications. In order to show the performance of the proposed system, a comparison is presented that evaluates the security improvements with respect to traditional randomization methods within smart contracts., This work has been funded by grant TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
RUC. Repositorio da Universidade da Coruña
Publicación Reseña (Review)

An Overview of Blockchain for Industry 5.0: Towards Human-Centric, Sustainable and Resilient Applications

  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
  • Rosado da Cruz, António M.
  • Lopes, Sérgio Ivan
[Abstract]: Industry 5.0 is an evolving concept that aims to enhance the way modern factories operate by seeking long-term growth, production efficiency and the well-being of industrial workers. Human-centricity, sustainability and resilience are the three pillars of Industry 5.0, which are developed on Industry 4.0 enabling technologies. One of the most compelling technologies to help implement the communications architecture proposed by Industry 5.0 is blockchain, which can provide trustworthy, secured and decentralized information to different industrial domains. This article provides an analysis of the transition between Industry 4.0 and Industry 5.0 paradigms. Moreover, it examines the benefits and challenges that arise when using blockchain to develop Industry 5.0 applications and analyzes the design factors that should be considered when developing this type of applications. Furthermore, it presents a thorough review on the most relevant blockchain-based applications for Industry 5.0 pillars. Therefore, the main goal of this article is to provide a comprehensive and detailed guide for future Industry 5.0 developers that allows for determining how blockchain might benefit the next generation of human-centric, sustainable, and resilient applications., This work has been funded by the Xunta de Galicia (by grant ED431C 2020/15), and by grants PID2020-118857RA-100 (ORBALLO) and TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR. We wish to acknowledge the support received from the Centro de Investigación de Galicia ‘‘CITIC’’, funded by Xunta de Galicia and the European Union. Paula Fraga-Lamas and Tiago M. Fernández-Caramés would like to thank CITIC for its support for the research stay that led to this article. Sergio Ivan Lopes has been funded by grant NORTE-01-0145-FEDER-000043, in the scope of project TECH–Technology, Environment, Creativity and Health, supported by Norte Portugal Regional Operational Program (NORTE 2020), under the PORTUGAL 2020 Partnership Agreement, through the European Regional Development Fund (ERDF)., Xunta de Galicia; ED431C 2020/15, Portugal. NORTE-01-0145-FEDER-000043
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Breaking Barriers for Minority Languages: Development and Evaluation of the First Galician On-Device ASR Model for Metaverse Applications

  • Valladares Poncela, Antón
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Presented at: 2024 IEEE 3rd International Conference on Intelligent Reality (ICIR 2024), 5-6 December 2024, Coimbra (Portugal), [Abstract]: This paper presents the development and evaluation of the first Automatic Speech Recognition (ASR) model for the Galician language, specifically designed for Metaverse applications using Microsoft HoloLens 2 smart glasses. The Metaverse is an expanding digital space for immersive interactions using different Extended Reality (XR) technologies, where voice-based communication is essential for an intuitive User Experience (UX). For minority languages, voice interaction is especially valuable as it promotes accessibility in this new environment by removing linguistic barriers. While ASR systems for highresource languages like English and Mandarin are becoming increasingly common in the Metaverse, there are no existing models optimized for Metaverse applications for Galician, a lowresource language spoken by approximately 3.2 million people. The developed ASR system leverages a fine-tuned Wav2Vec 2.0 model optimized specifically for on-device inference in ARM64 architectures, ensuring low latency without relying on cloudbased solutions. Performance evaluations indicate a Character Error Rate (CER) below 6.7 % and an average latency of 2.98 seconds, demonstrating the model effectiveness in realtime transcription tasks in computationally constrained devices such as the Microsoft HoloLens 2. Thus, this paper lays the groundwork for the future integration of Galician and other minority languages in the development of Metaverse applications., This work has been funded by grant TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Patrones Oscuros para Realidad Extendida: Desafíos Éticos y Prácticos

  • Ramil López, Diego
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Presentado en: XXXIX Simposio Nacional de la Unión Científica Internacional de Radio, URSI 2024, Escuela Politécnica de Cuenca, Universidad de Castilla-La Mancha, 4 a 6 de septiembre de 2024., [Abstract]: The fusion of Augmented, Mixed and Virtual Reality known as Extended Reality (XR) is revolutionizing how we interact with digital environments. This paper explores the concept of dark patterns, which are intentionally deceptive user interface designs that manipulate users into making decisions that benefit the designer. Investigating these dark patterns in XR application design is of interest because it reveals how they can impact user experience, raise ethical concerns, and have far-reaching implications in near-future Metaverse applications. Furthermore, the introduction of a novel classification system for XR, comprising five types of dark patterns, underscores the importance of enhanced user education and stricter ethical guidelines enforcement to safeguard privacy and data in XR scenarios. This approach provides a comprehensive understanding of the practical hurdles posed by dark patterns, encompassing issues like user wellbeing, ethical design, and the influence of these patterns on user perceptions and behaviors within the rapidly advancing technological landscape., Esta publicación es parte del proyecto de I+D+i TED2021-129433A-C22 (HELENE), financiado por MCIN/AEI/10.13039/501100011033 y por la “Unión Europea NextGenerationEU/PRTR”.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

A Validation System for Academic Records based on Blockchain

  • Fernández-Blanco, Gabriel
  • Fernández-Caramés, Tiago M.
Cursos e Congresos, C-155, [Abstract] Academic certificate forgeries and the lack of resources to tackle them is a problem that implies big costs to society. It harms the figure of the certificates and impairs the trust of academic institutions. The solution proposed in this paper is aimed at recording and verifying the academic merits through a decentralized application or Dapp. Such an application is supported by a smart contract deployed in the Ethereum blockchain with a simple frontend or interface. The application makes use of a decentralized storing system based on IPFS in order to consume the data that are not managed by the blockchain. To assess the performance of the developed system, the latency of its most common operation (read operations) is measured as the number of requests per second increase. The obtained results show that the system is really fast, being some nodes able to respond to more than 1,000 requests in less than one millisecond, Xunta de Galicia; ED431C 2020/15, This work has been funded by CITIC that is funded by the Xunta de Galicia through the collaboration agreement between the Consellería de Cultura, Educación, Formación Profesional e Universidades and the Galician universities for the reinforcement of the research centres of the Galician University System (CIGUS), by the Xunta de Galicia (by grant ED431C 2020/15), and by grants PID2020-118857RA-100 (ORBALLO) and TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

On-Device Automatic Speech Recognition for IIoT and Extended Reality Industrial Metaverse Applications

  • Valladares Poncela, Antón
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Presented at The 11th International Electronic Conference on Sensors and Applications (ECSA-11), 26–28 November 2024, Online; Available online: https://sciforum.net/event/ecsa-11., [Abstract]: This paper presents a comprehensive study on enhancing Industrial Internet of Things (IIoT) and Industrial Metaverse applications through the integration of On-Device Automatic Speech Recognition (ASR) using Microsoft HoloLens 2 smart glasses. Specifically, this paper focuses on the utilization of the HoloLens 2 microphone array and sound capture APIs to benchmark the performance and accuracy of on-device ASR models. The evaluation of these models includes metrics such as Character Error Rate (CER), Word Error Rate (WER) and latency. In addition, this paper explores various optimization techniques, including quantization tools and model refinement strategies, aimed at minimizing latency while maintaining high accuracy. This study also emphasizes the importance of supporting low-resource languages, using Galician—a language spoken by less than 3 million people worldwide—as a case study. By benchmarking different variations of a Wav2Vec2.0-based ASR model fine-tuned for Galician, the most effective models are identified, as well as their optimal runtime configurations. This work underscores the critical role of low-latency on-device ASR systems in real-time IIoT and Industrial Metaverse applications, highlighting how these technologies can enhance operational efficiency, privacy and user experience in industrial environments. The findings demonstrate the significant potential of the on-device ASR system developed to enhance voice interactions in emerging Metaverse applications, specially for low-resource languages., This work has been supported by Centro Mixto de Investigación UDC-NAVANTIA (IN853C 2022/01), funded by GAIN (Xunta de Galicia) and ERDF Galicia 2021-2027 and TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR., Xunta de Galicia; IN853C 2022/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Towards a Blockchain and Opportunistic Edge Driven Metaverse of Everything

  • Fraga-Lamas, Paula
  • Lopes, Sérgio Ivan
  • Fernández-Caramés, Tiago M.
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Decentralized Metaverses, built on Web 3.0 and Web 4.0 technologies, have attracted significant attention across various fields. This innovation leverages blockchain, decentralized autonomous organizations, extended reality, and advanced technologies to create immersive and interconnected digital environments that mirror the real world. This article delves into the Metaverse of Everything (MoE), a platform that fuses the Metaverse concept with the Internet of Everything (IoE), an advanced version of the Internet of Things (IoT) that connects not only physical devices but also people, data, and processes within a networked environment. Thus, the MoE integrates generated data and virtual entities, creating an extensive network of interconnected components. This article seeks to advance current MoE, examining decentralization and the application of opportunistic edge computing for interactions with surrounding IoT devices and IoE entities. Moreover, it outlines the main challenges to guide researchers and businesses toward building a future cyber-resilient opportunistic MoE, This work has been funded by Grants TED2021-129433A-C22 (HELENE) and PID2020-118857RA-100 (ORBALLO), funded by the MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR; and by Project “TEXPCT: Pacto de inovacção para a digitalização do STV,” funded under the Recovery and Resilience Plan 02-C05-i01.01-2022.PC644915249-00000025, under the scope of the project “WP 2.2 (PPS#8): Digital Twin Platform for Textile Manufacturing.” CITIC, as a center accredited for excellence within the Galician University System and a member of the CIGUS Network, receives subsidies from the Department of Education, Science, Universities, and Vocational Training of the Xunta de Galicia. Additionally, it is cofinanced by the EU through the FEDER Galicia 2021-27 operational program (Ref. ED431G 2023/01). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431G 2023/01, Agência para a Competitividade e Inovação IP (Portugal); 02-C05-i01.01-2022.PC644915249-00000025
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

A Blockchain Based System for Preventing Academic Forgery: Design and Practical Evaluation for CPU-Based and Low-Power Computers

  • Fernández-Blanco, Gabriel
  • Froiz-Míguez, Iván
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
This version of the article has been accepted for publication, after peer review. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The Version of Record is available online at: https://doi.org/10.1109/BCCA62388.2024.10844456, Presented at: 2024 6th International Conference on Blockchain Computing and Applications (BCCA), Dubai, United Arab Emirates. https://bcca-conference.org/2024/, [Abstract]: This paper describes a lightweight proof-of-concept that tackles the problem of academic certificate forgery with the use of a smart contract deployed in the Ethereum blockchain. The implemented application allows to request, update, download and verify students Academic Records (AR) easily. These ARs are backed up by a decentralized storage system based on InterPlanetary File System (IPFS). The ARs modifications are secured and tamper-proof, since they need to be approved by the network. Furthermore, this proof-of-concept was conceived to support future functionalities such as the verification of Curriculum Vitae (CV) merits, so its architecture could be the basis of many other types of decentralized applications. Not only was the application tested in terms of energy efficiency and performance, but it was also deployed on Single-Board Computers (SBCs) to evaluate its performance in an IoT network., This work has been funded by grant TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Design, Implementation, and Practical Evaluation of a Voice Recognition Based IoT Home Automation System for Low-Resource Languages and Resource-Constrained Edge IoT Devices: A System for Galician and Mobile Opportunistic Scenarios

  • Froiz-Míguez, Iván
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
[Abstract]: Systems with voice control are an attractive option for increasing technological integration, not only for people with little knowledge on technology or constrained Internet access, but also for people with certain disabilities. In addition, devices based on Alexa or Google Home provide an interesting alternative for interacting with Internet of Things (IoT) devices, but they usually rely on an Internet connection to a cloud server for their full operation. Furthermore, many voice-recognition systems are only available in a limited number of languages, which tend to be those with the highest number of speakers, thus excluding minority-language speakers. To address the previously mentioned issues, this article presents a solution based on Edge Computing and voice commands that carries out offline voice processing and that is able to interact with IoT-based systems. The proposed system performs local speech inference, providing a communication interface with IoT devices in a Bluetooth mesh, all in a fast way and without the need for an Internet connection. In addition, the proposed solution can be adapted easily for voice recognition of languages with few resources. Such a feature is demonstrated with the Galician language, which is spoken by less than 3 million people worldwide. In particular, different Automatic Speech Recognition (ASR) models based on three of the most popular ASR development frameworks (wav2vec2, DistilHubert, Whisper) were developed to transcribe short speech and to translate it into IoT commands that perform specific home-automation actions. Such models were fine-tuned for Galician with a corpus of approximately 20 hours and were evaluated in static and mobile opportunistic scenarios in terms of accuracy, energy consumption and latency on an embedded platform (that acts as an edge device) and on a cloud server. The obtained results show that inference is performed in less than 2 seconds on a Raspberry Pi 4 for the two smallest models and in less than 500 ms on a high-end Android smartphone when processing all data locally with CPU-only inference (i.e., without hardware acceleration or external processing). The results of the transcriptions are accurate enough to be able to use simple text distance algorithms to detect keywords in the speech and perform commands on IoT devices. In particular, a maximum success rate of 92% was achieved for detecting the indicated commands when using models optimized for being executed on embedded devices. For selected home scenarios, command actions were sent via Bluetooth with average response times of up to 113 ms., This work has been funded by the Xunta de Galicia (by grant ED431C 2020/15), and by grants PID2020-118857RA-100 (ORBALLO) and TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR., Xunta de Galicia; ED431C 2020/15
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

An Intelligent IoT Wearable for Monitoring and Preventing Asthma Attacks

  • García-Rivada, Pablo
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Cursos e Congresos , C-155, [Abstract] Asthma is a chronic disease that affects the respiratory tract, inflicting coughing, wheezing and difficulty for breathing. In order to mitigate these problems, this paper introduces an IoT wearable that is able to monitor the state of an asthma patient: breathing frequency, heart rate and oxygen saturation level. It also detects parameters that may worsen the situation of the patient: temperature, humidity and presence of gas or particles. The system also notifies the patient when he/she has to take his/her asthma medication. The value of the parameters is shared in real time by Bluetooth and historic values are stored in a database. The system uses color-based indications to calculate the risk level. With this information, the user can detect an asthma attack before it happens. To illustrate how the system operates, asthma attacks were simulated, showing that the system is able to determine that the attack is happening based on the specified input parameters, Xunta de Galicia; ED431C 2020/15, This work has been funded by the Xunta de Galicia (by grant ED431C 2020/15), and by grants PID2020-118857RA-100 (ORBALLO) and TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the EuropeanUnionNextGenerationEU/PRTR. CITIC is funded by the Xunta de Galicia through the collaboration agreement between the Consellería de Cultura, Educación, Formación Profesional eUniversidades and the Galician universities for the reinforcement of the research centres of the Galician University System (CIGUS)
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Towards an Emotion-Aware Metaverse: A Human-Centric Shipboard Fire Drill Simulator

  • Hamed-Ahmed, Musaab H.
  • Ramil López, Diego
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
[Abstract]: Traditional Extended Reality (XR) and Metaverse applications focus heavily on User Experience (UX) but often overlook the role of emotions in user interaction. This article addresses that gap by presenting an emotion-aware Metaverse application: a Virtual Reality (VR) fire drill simulator for shipboard emergency training. The simulator detects emotions in real time, assessing trainees’ responses under stress to improve learning outcomes. Its architecture incorporates eye-tracking and facial expression analysis via Meta Quest Pro headsets. Two experimental phases were conducted. The first revealed issues like poor navigation and lack of visual guidance. These insights led to an improved second version with a refined User Interface (UI), a real-time task tracker and clearer visual cues. The obtained results showed that the included design improvements can reduce task completion times between 14.18% and 32.72%. Emotional feedback varied, suggesting a need for more immersive elements. Overall, this article provides useful guidelines for creating the next generation of emotion-aware Metaverse applications., This work has been funded by grant TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR. In addition, this work has been supported by Centro Mixto de Investigación UDC-NAVANTIA (IN853C 2022/01), funded by GAIN (Xunta de Galicia) and ERDF Galicia 2021–2027., Xunta de Galicia; IN853C 2022/01
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Towards the Industrial Metaverse: A Game-Based VR Application for Fire Drill and Evacuation Training for Ships and Shipbuilding

  • Hamed-Ahmed, Musaab H.
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Presented at: Web3D '24: Proceedings of the 29th International ACM Conference on 3D Web Technology Article, September 25–27, 2024, Guimarães, Portugal, This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in https://doi.org/10.1145/3665318.3678229., [Abstract]: This paper details the creation of a novel Virtual Reality-based application for the Industrial Metaverse aimed at shipboard fire emergency training for fire drill and evacuation, aligned with the Safety of Life at Sea (SOLAS) convention requirements. Specifically, the application includes gamified scenarios with different levels (e.g., varying fire intensities in engine rooms and galleys). The paper details comprehensively the VR development while providing a holistic overview and practical guidelines. Thus, it can guide practitioners, developers and future researchers to shape the next generation of Industrial Metaverse applications for the shipbuilding industry. Moreover, the paper includes the results of a preliminary user evaluation aimed at quantifying user decision-making and risk assessment skills. The presented results of the experiments provide insights into user performance and allow for pointing out at different future challenges., This work has been funded by grants TED2021-129433A-C22 (HELENE) and PID2020-118857RA-100 (ORBALLO) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR, and by contract "Colaboración en proyecto ARGOS" (F22/11, CITIC).
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Off-Cloud Anchor Sharing Framework for Multi-User and Multi-Platform Mixed Reality Applications

  • Vidal-Balea, Aida
  • Blanco, Óscar
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
[Abstract]: This article presents a novel off-cloud anchor sharing framework designed to enable seamless device interoperability for Mixed Reality (MR) multi-user and multi-platform applications. The proposed framework enables local storage and synchronization of spatial anchors, offering a robust and autonomous alternative for real-time collaborative experiences. Such anchors are digital reference points tied to specific positions in the physical world that allow virtual content in MR applications to remain accurately aligned to the real environment, thus being an essential tool for building collaborative MR experiences. This anchor synchronization system takes advantage of the use of local anchor storage to optimize the sharing process and to exchange the anchors only when necessary. The framework integrates Unity, Mirror and Mixed Reality Toolkit (MRTK) to support seamless interoperability between Microsoft HoloLens 2 devices and desktop computers, with the addition of external IoT interaction. As a proof of concept, a collaborative multiplayer game was developed to illustrate the multi-platform and anchor sharing capabilities of the proposed system. The experiments were performed in Local Area Network (LAN) and Wide Area Network (WAN) environments, and they highlight the importance of efficient anchor management in large-scale MR environments and demonstrate the effectiveness of the system in handling anchor transmission across varying levels of spatial complexity. Specifically, the obtained results show that the developed framework is able to obtain anchor transmission times that start around 12.7 s for the tested LAN/WAN networks and for small anchor setups, and to roughly 86.02–87.18 s for complex physical scenarios where room-sized anchors are required., This work has been funded by grants PID2020-118857RA-100 (ORBALLO) and TED2021-129433A-C22 (HELENE) funded by MCIN/AEI/10.13039/501100011033 and the European Union NextGenerationEU/PRTR.
RUC. Repositorio da Universidade da Coruña
Publicación Contribución de congreso (ConferenceOutput)

Evaluación Práctica de las APIs de Procesado de Audio de Microsoft HoloLens 2 para el Desarrollo de Aplicaciones de Realidad Mixta con ASR

  • Valladares Poncela, Antón
  • Fraga-Lamas, Paula
  • Fernández-Caramés, Tiago M.
Presentado en: XXXIX Simposio Nacional de la Unión Científica Internacional de Radio, URSI 2024, Escuela Politécnica de Cuenca, Universidad de Castilla-La Mancha, 4 a 6 de septiembre de 2024., [Abstract]: Automatic Speech Recognition (ASR) is emerging as a crucial technology for voice recognition in future Extended Reality (XR) and Metaverse applications, enabling natural interactions with virtual and IoT objects. This paper evaluates the performance of Microsoft HoloLens 2 microphone APIs for sound acquisition, quality and noise cancellation in Mixed Reality (MR) scenarios. Three APIs are assessed focusing on sound quality, noise cancellation and speech filtering processes using ASR metrics like Character Error Rate (CER) and Word Error Rate (WER). The provided findings offer insights for MR developers, emphasizing the importance of selecting the right API to enhance sound quality and ASR model precision. This highlights the significance of proper API selection for optimizing MR applications., Esta publicación es parte del proyecto de I+D+i TED2021-129433A-C22 (HELENE), financiado por MCIN/AEI/10.13039/501100011033 y por la “Unió Europea NextGenerationEU/PRTR”. Los autores quieren también agradecer a Iván Froiz-Míguez su colaboración en el desarrollo de los modelos de ASR y a Aida Vidal-Balea su ayuda en el desarrollo del entorno de RM.