Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 7
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Virtual Experience Toolkit: An End-to-End Automated 3D Scene Virtualization Framework Implementing Computer Vision Techniques

  • Mora-García, Pau|||0009-0003-2741-9100
  • Ivorra, Eugenio|||0000-0001-6062-2061
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
  • García-Moll, Clara
  • Ortega Pérez, Mario
[EN] Virtualization plays a critical role in enriching the user experience in Virtual Reality (VR) by offering heightened realism, increased immersion, safer navigation, and newly achievable levels of interaction and personalization, specifically in indoor environments. Traditionally, the creation of virtual content has fallen under one of two broad categories: manual methods crafted by graphic designers, which are labor-intensive and sometimes lack precision; traditional Computer Vision (CV) and Deep Learning (DL) frameworks that frequently result in semi-automatic and complex solutions, lacking a unified framework for both 3D reconstruction and scene understanding, often missing a fully interactive representation of the objects and neglecting their appearance. To address these diverse challenges and limitations, we introduce the Virtual Experience Toolkit (VET), an automated and user-friendly framework that utilizes DL and advanced CV techniques to efficiently and accurately virtualize real-world indoor scenarios. The key features of VET are the use of ScanNotate, a retrieval and alignment tool that enhances the precision and efficiency of its precursor, supported by upgrades such as a preprocessing step to make it fully automatic and a preselection of a reduced list of CAD to speed up the process, and the implementation in a user-friendly and fully automatic Unity3D application that guides the users through the whole pipeline and concludes in a fully interactive and customizable 3D scene. The efficacy of VET is demonstrated using a diversified dataset of virtualized 3D indoor scenarios, supplementing the ScanNet dataset., This research was funded by the European Community's Horizon 2020 (FETPROACT-2018-2020). Grant Agreement RIA-101017727 Experience. The author P.M. is the beneficiary of a University Teacher Training scholarship granted by the Spanish Ministry of Universities.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Heart rate variability analysis for the assessment of immersive emotional arousal using virtual reality: Comparing real and virtual scenarios

  • Marín-Morales, Javier|||0000-0003-1271-2892
  • Guixeres Provinciale, Jaime
  • Llinares Millán, María Del Carmen|||0000-0003-2270-807X
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
  • Higuera-Trujillo, Juan Luis
  • Valenza, Gaetano
[EN] Many affective computing studies have developed automatic emotion recognition models, mostly using emotional images, audio and videos. In recent years, virtual reality (VR) has been also used as a method to elicit emotions in laboratory environments. However, there is still a need to analyse the validity of VR in order to extrapolate the results it produces and to assess the similarities and differences in physiological responses provoked by real and virtual environments. We investigated the cardiovascular oscillations of 60 participants during a free exploration of a real museum and its virtualisation viewed through a head-mounted display. The differences between the heart rate variability features in the high and low arousal stimuli conditions were analysed through statistical hypothesis testing; and automatic arousal recognition models were developed across the real and the virtual conditions using a support vector machine algorithm with recursive feature selection. The subjects' self-assessments suggested that both museums elicited low and high arousal levels. In addition, the real museum showed differences in terms of cardiovascular responses, differences in vagal activity, while arousal recognition reached 72.92% accuracy. However, we did not find the same arousal-based autonomic nervous system change pattern during the virtual museum exploration. The results showed that, while the direct virtualisation of a real environment might be self-reported as evoking psychological arousal, it does not necessarily evoke the same cardiovascular changes as a real arousing elicitation. These contribute to the understanding of the use of VR in emotion recognition research; future research is needed to study arousal and emotion elicitation in immersive VR., The research leading to these results has received partial funding from the European Commission (Project HELIOS H2020-825585 and Project EXPERIENCE H2020-101017727), from the Universitat Politecnica de Valencia (PAID-10-20), and from the Italian Ministry of Education and Research (MIUR) ("Department of Excellence" CrossLab project for the Univ. of Pisa). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Acceptability, Usability, and Insights Into Cybersickness Levels of a Novel Virtual Reality Environment for the Evaluation of Depressive Symptoms: Exploratory Observational Study

  • Sutori, Sara
  • Eliasson, Emma Therese
  • Mura, Francesca
  • Ortiz, Victor
  • Catrambonephd, Vincenzo
  • Hadlaczky, Gergo
  • Todorov, Ivo
  • Alfeo, Antonio Luca
  • Cardi, Valentina
  • Cimino, Mario G. C. A.
  • Mioni, Giovanna
  • Valenza, Gaetano
  • Carli, Vladimir
  • Gentili, Claudio
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] Background: There is a clear need for enhanced mental health assessment, depressive symptom (DS) evaluation being no exception. A promising approach to this aim is using virtual reality (VR), which entails the potential of adding a wider set of assessment domains with enhanced ecological validity. However, whilst several studies have used VR for both diagnostic and treatment purposes, its acceptance, in particular how exposure to virtual environments affects populations with psychiatric conditions remains unknown. Objective: This study aims to report on the acceptability, usability, and cybersickness levels of a pilot VR environment designed for the purpose of differentiating between individuals with DSs. Methods: The exploratory study, conducted in Italy, included 50 healthy controls and 50 young adults with mild-to-moderate DSs (without the need for a formal diagnosis). The study used an observational design with approximately 30 minutes of VR exposure followed by a self-report questionnaire battery. The battery included a questionnaire based on theTheoretical Framework of Acceptability, the System Usability Scale as well as the Simulator Sickness Questionnaire. Results: Results indicate that the majority found VR acceptable for the purposes of mental health screening and treatment. However, for diagnostics, there was a clear preference for VR to be used by mental health professionals as a supplementary tool, as opposed to a stand-alone solution. In practice, following exposure to the pilot VR environment, generally, good levels of acceptability and usability were reported, but areas in need of improvement were identified (such as self-efficacy). Self-reported cybersickness levels were comparable to literature averages but were considerably higher among those with DSs. Conclusions: These findings raise questions about the potential interplay between underlying somatic symptoms of depression and VR-induced cybersickness and call for more attention from the scientific community both in terms of methodology as well as potential clinical and theoretical implications. Conclusively, user support indicates a potential for VR to aid mental health assessment, but further research is needed to understand how exposure to virtual environments might affect populations with varying severity and other forms of psychiatric symptoms., The study was carried out within the EXPERIENCE project, which is funded by the European Commission H2020 Framework Program (grant 101017727) .
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Contribución de congreso (ConferenceOutput)

Virtual Experience Toolkit: Enhancing 3D Scene Virtualization from Real Environments through Computer Vision and Deep Learning Techniques

  • García-Moll, Clara
  • Ortega Pérez, Mario
  • Valenza, Gaetano
  • Mora-García, Pau|||0009-0003-2741-9100
  • Ivorra, Eugenio|||0000-0001-6062-2061
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] Over the past few decades, Virtual Reality (VR) has emerged as a popular topic in a wide range of fields, such as information technology and psychology, among others. One reason for its importance was due to the ability to virtualize real-world scenes. This process typically involves capturing data from those scenes to generate accurate, detailed, and immersive 3D models. However, the creation of virtual content from realworld scenes has traditionally relied on manual techniques, as well as photogrammetry or Computer Vision (CV) algorithms. This frequently yields time-intensive, less accurate, intricate, and semi-automatic results. To tackle these limitations, a novel framework called Virtual Experience Toolkit (VET) has been proposed. It employs CV and Deep Learning (DL) techniques to swiftly and seamlessly virtualize any 3D scenario from real indoor environments. To demonstrate the effectiveness of VET, a diverse dataset of virtualized 3D scenes was generated, supplementing the information from the ScanNet dataset. VET has the potential to significantly enhance the virtualization of 3D indoor scenarios from real scenes, making the process easier, more precise, unified, consistent, automated, and effective for a broad spectrum of VR applications., The research leading to these results has received partial funding from the European Commission under grant agreement N. 101017727 for the project EXPERIENCE.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

The EXPERIENCE Project: Automatic virtualization of &quot, extended personal reality&quot, through biomedical signal processing and explainable artificial intelligence [Applications Corner]

  • Valenza, Gaetano
  • Carli, Vladimir
  • Dudnik, Gabriela
  • Gentili, Claudio
  • Provinciale, Jaime Guixeres
  • Rossi, Simone
  • Toschi, Nicola
  • van Wassenhove, Virginie
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] The transformation of communication media has revolutionized social interactions, incorporating audio and video into our lives. Despite the recent availability of virtual reality (VR) technology, its widespread adoption faces obstacles. Technological challenges in creating VR environments and scientific confounding concerning interindividual variability in responses to virtual simulations are key factors hindering its broader integration. The EXPERIENCE project makes real the complex interplay among multisensory perception, emotional responses, and extended social interactions by allowing the public-at-large to create their own VR environments automatically through portable devices (e.g., smartphones/tablets) without the need for technical skills. The VR environment augmented by an individual's physiological responses, psychological and cognitive descriptors, and behavioral outcomes defines the individual's subjective experience, namely, an individual's extended personal reality (EPR). The virtualization of a person's EPR provides a holistic and quantitative environment that can be shared with others to transfer personalized psychological and emotional responses. Additionally, EPR assessment enables subsequent manipulation of the VR through explainable artificial intelligence (AI) routines merging multisensory biofeedback, individualized perception of time-space, and neuromodulation. This technology can be exploited in a plethora of innovative scenarios, including mental healthcare, gaming, e-learning, and neuroeconomics, also leading to the creation of a new market for sharing and selling (virtual) experiences., The EXPERIENCE project has received funding from the European Commission Horizon 2020 Research and Innovation Program under Grant Agreement 101017727. The EXPERIENCE project is part of the crossproject collaboration SECTG comprising the SONICOM project [16], the CAROUSE L proje ct , the TOUCHLESS project, and the GUESTXR project. Gaetano Valenza is the corresponding author.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Feasibility of virtual reality and machine learning to assess personality traits in an organizational environment

  • Parra Vargas, Elena|||0000-0002-0279-9827
  • Marín-Morales, Javier|||0000-0003-1271-2892
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
  • Carrasco-Ribelles, Lucia Amalia
  • Ayuso-Molina, Carla
[EN] Introduction: Personality plays a crucial role in shaping an individual¿s interactions with the world. The Big Five personality traits are widely used frameworks that help describe people¿s psychological behaviours. These traits predict how individuals behave within an organizational setting. Methods: In this article, we introduce a virtual reality (VR) strategy for relatively scoring an individual¿s personality to evaluate the feasibility of predicting personality traits from implicit measures captured from users interacting in VR simulations of different organizational situations. Specifically, eye-tracking and decision-making patterns were used to classify individuals according to their level in each of the Big Five dimensions using statistical machine learning (ML) methods. The virtual environment was designed using an evidence-centered design approach. Results: The dimensions were assessed using NEO-FFI inventory. A random forest ML model provided 83% accuracy in predicting agreeableness. A k-nearest neighbour ML model provided 75%, 75%, and 77% accuracy in predicting openness, neuroticism, and conscientiousness, respectively. A support vector machine model provided 85% accuracy for predicting extraversion. These analyses indicated that the dimensions could be differentiated by eye-gaze patterns and behaviours during immersive VR. Discussion: Eye-tracking measures contributed more significantly to this differentiation than the behavioural metrics. Currently, we have obtained promising results with our group of participants, but to ensure the robustness and generalizability of our findings, it is imperative to replicate the study with a considerably larger sample. This study demonstrates the potential of VR and ML to recognize personality traits., The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This framework is developed as part of the EXPERIENCE project\footnote{EXPERIENCE PROJECT, Grant Agreement No. 101017727 Experience, https://experience-project.eu/.%7D, a European collaboration project involving multiple universities. The project receives funding from the European Union's Horizon 2020 research and innovation program.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Multishell diffusion MRI reveals whole-brain white matter changes in HIV

  • Minosse, Silvia
  • Picchi, Eliseo
  • Conti, Allegra
  • Giuliano, Francesca di
  • Ciò, Francesco di
  • Sarmati, Loredana
  • Teti, Elisabetta
  • De Santis, Silvia
  • Andreoni, Massimo
  • Floris, Roberto
  • Guerrisi, Maria
  • Garaci, Francesco
  • Toschi, Nicola
Diffusion tensor imaging (DTI) and diffusion kurtosis imaging (DKI) have been previously used to explore white matter related to human immunodeficiency virus (HIV) infection. While DTI and DKI suffer from low specificity, the Combined Hindered and Restricted Model of Diffusion (CHARMED) provides additional microstructural specificity. We used these three models to evaluate microstructural differences between 35 HIV-positive patients without neurological impairment and 20 healthy controls who underwent diffusion-weighted imaging using three b-values. While significant group effects were found in all diffusion metrics, CHARMED and DKI analyses uncovered wider involvement (80% vs. 20%) of all white matter tracts in HIV infection compared with DTI. In restricted fraction (FR) analysis, we found significant differences in the left corticospinal tract, middle cerebellar peduncle, right inferior cerebellar peduncle, right corticospinal tract, splenium of the corpus callosum, left superior cerebellar peduncle, left superior cerebellar peduncle, pontine crossing tract, left posterior limb of the internal capsule, and left/right medial lemniscus. These are involved in language, motor, equilibrium, behavior, and proprioception, supporting the functional integration that is frequently impaired in HIV-positivity. Additionally, we employed a machine learning algorithm (XGBoost) to discriminate HIV-positive patients from healthy controls using DTI and CHARMED metrics on an ROIwise basis, and unique contributions to this discrimination were examined using Shapley Explanation values. The CHARMED and DKI estimates produced the best performance. Our results suggest that biophysical multishell imaging, combining additional sensitivity and built-in specificity, provides further information about the brain microstructural changes in multimodal areas involved in attentive, emotional and memory networks often impaired in HIV patients., This work is supported by: #NEXTGENERATIONEU (NGEU) and funded by the Ministry of University and Research (MUR), National Recovery and Resilience Plan (NRRP), project MNESYS (PE0000006) (to NT)– A Multiscale integrated approach to the study of the nervous system in health and disease (DN. 1553 11.10.2022); by the MUR-PNRR M4C2I1.3 PE6 project PE00000019 Heal Italia (to NT); by the NATIONAL CENTRE FOR HPC, BIG DATA AND QUANTUM COMPUTING, within the spoke “Multiscale Modeling and Engineering Applications” (top NT); The European Innovation Council (Project CROSSBRAIN, Grant Agreement n. 101070908, Project BRAINSTORM, Grant Agreement 101099355); And by the Horizon 2020 research and innovation Programme (Project EXPERIENCE: Grant Agreement 101017727)., Peer reviewed