Pasar al contenido principal

ENTORNOS 3D DE ALTA FIDELIDAD PARA REALIDAD VIRTUAL Y COMPUTACION VISUAL: GEOMETRIA, MOVIMIENTO, INTERACCION Y VISUALIZACION PARA SALUD, ARQUITECTURA Y CIUDADES

PID2021-122136OB-C21

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2021
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 26
Encontrada(s) 1 página(s)

Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Enriching Medieval 4D Models with Interactive Narratives

  • Andujar, Carlos
  • Cayuela Vellido, Begoña
  • Lorés, Immaculada
  • Bosch Geli, Carles
  • Guardia Pons, Milagros
  • Muñoz-Pandiella, Imanol
Digital technologies are increasingly used in cultural heritage preservation and dissemination, but some monuments pose significant challenges due to substantial historical architectural and pictorial changes. This paper introduces a method to enrich multi-layered, multi-phase 3D models of cultural heritage with art history knowledge. This is achieved through imagebased annotations, interactive narratives, points of interest, text, and audio, creating guided tours of the monument’s historical phases. The approach is user-friendly for art historians, requiring no programming skills for defining such elements. A pilot user evaluation demonstrated its effectiveness in enhancing visitor engagement and understanding, and allowed improving the final web-based application and narratives., This work has been partially supported by projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and ERDF "A way of making Europe", by the EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127), the Spanish Agencia Estatal de Investigación (grant PCI2020-111979) and by the Department of Research and Universities of the Government of Catalonia (2021 SGR 01035).
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Enriching medieval 4D models with interactive narratives

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Cayuela Vellido, Begoña
  • Lorès Otzet, Immaculada
  • Bosch Geli, Carles
  • Guardia Pons, Milagros
  • Muñoz Pandiella, Imanol|||0000-0002-4781-7574
Digital technologies are increasingly used in cultural heritage preservation and dissemination, but some monuments pose significant challenges due to substantial historical architectural and pictorial changes. This paper introduces a method to enrich multi-layered, multi-phase 3D models of cultural heritage with art history knowledge. This is achieved through imagebased annotations, interactive narratives, points of interest, text, and audio, creating guided tours of the monument's historical phases. The approach is user-friendly for art historians, requiring no programming skills for defining such elements. A pilot user evaluation demonstrated its effectiveness in enhancing visitor engagement and understanding, and allowed improving the final web-based application and narratives., This work has been partially supported by projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and ERDF "A way of making Europe", by the EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127), the Spanish Agencia Estatal de Investigación (grant PCI2020-111979) and by the Department of Research and Universities of the Government of Catalonia (2021 SGR 01035)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Bidirectional exploration of 3D cultural heritage models and photo collections

  • Borràs Civil, Bernat
  • Muñoz Pandiella, Imanol|||0000-0002-4781-7574
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Advances in 3D digitization have greatly improved the availability of high-quality cultural heritage datasets, often consisting of 3D models and collections of high-resolution photos. However, navigating these 3D datasets poses challenges for art history researchers, especially when they need to repeatedly locate points of interest, get close-up views of them, and analyze their spatial relationships. Existing applications for 3D model sharing often fail to provide a convenient interface to simultaneously explore the 3D model and associated photo collections. This paper proposes a web-based approach that combines a 3D view of the model with a 2D view of a group of photos. Designers can quickly arrange groups of images into 2D projections, and cultural heritage users can explore the 3D model and, simultaneously, the active group of images in the 2D view. Both views are interlinked, so that navigating the 3D model modifies the active photo group, and clicking an image in the 2D view moves the 3D camera to the 3D position the image was taken from. We tested our approach with a 3D dataset on medieval mural paintings. Our tests show that our method helps users quickly locate, inspect and relate different parts of the model, reducing navigation time and frustration. The source code is available at https://github.com/BernatBC/visualitzador-de-fotografies-en-3D., This work has been partially supported by the project PID2021-122136OBC21 funded by MCIN/AEI/ 10.13039/501100011033 and ERDF "A way of making Europe", and by the Department of Research and Universities of the Government of Catalonia (2021 SGR 01035)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Effect of color palettes in heatmaps perception: a study

  • Molina López, Elena|||0000-0003-4561-6215
  • Middel Soria, Carolina
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
Heatmaps are a widely used technique in visualization. Unfortunately, they have not been investigated in depth and little is known about the best parameterizations so that they are properly interpreted. The effect of different palettes on our ability to read values is still unknown. To address this issue, we conducted a user study, in which we analyzed the effect of two commonly used color palettes, Blues and Viridis, on value estimation and value search. As a result, we provide some suggestions for what to expect from the heatmap configurations analyzed., This paper has been supported by PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovación, by 839 FEDER (EU) funds. Elena Molina has been supported by FI-SDUR doctoral grant from Generalitat de Catalunya, and FPU grant from the Ministerio de Ciencia e Innovación., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Are LLMs ready for visualization?

  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Generative models have received a lot of attention in many areas of academia and the industry. Their capabilities span many areas, from the invention of images given a prompt to the generation of concrete code to solve a certain programming issue. These two paradigmatic cases fall within two distinct categories of requirements, ranging from "creativity" to "precision", as characterized by Bing Chat, which employs ChatGPT-4 as its backbone. Visualization practitioners and researchers have wondered to what end one of such systems could accomplish our work in a more efficient way. Several works in the literature have utilized them for the creation of visualizations. And some tools such as Lida, incorporate them as part of their pipeline. Nevertheless, to the authors’ knowledge, no systematic approach for testing their capabilities has been published, which includes both extensive and in-depth evaluation. Our goal is to fill that gap with a systematic approach that analyzes three elements: whether Large Language Models are capable of correctly generating a large variety of charts, what libraries they can deal with effectively, and how far we can go to configure individual charts. To achieve this objective, we initially selected a diverse set of charts, which are commonly utilized in data visualization. We then developed a set of generic prompts that could be used to generate them, and analyzed the performance of different LLMs and libraries. The results include both the set of prompts and the data sources, as well as an analysis of the performance with different configurations., Supported by Ministerio de Ciencia e Innovación/AEI (PID2021-122136OB-C21 by 10.13039/501100011033/FEDER, UE)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Exploring the role of expected collision feedback in crowded virtual environments

  • Yun, Haoran
  • Pontón Martínez, José Luis|||0000-0001-6576-4528
  • Beacco Porres, Alejandro|||0000-0001-8192-1431
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
An increasing number of virtual reality applications require environments that emulate real-world conditions. These environments often involve dynamic virtual humans showing realistic behaviors. Understanding user perception and navigation among these virtual agents is key for designing realistic and effective environments featuring groups of virtual humans. While collision risk significantly influences human locomotion in the real world, this risk is largely absent in virtual settings. This paper studies the impact of the expected collision feedback on user perception and interaction with virtual crowds. We examine the effectiveness of commonly used collision feedback techniques (auditory cues and tactile vibrations) as well as inducing participants to expect that a physical bump with a real person might occur, as if some virtual humans actually correspond to real persons embodied into them and sharing the same physical space. Our results indicate that the expected collision feedback significantly influences both participant behavior—encompassing global navigation and local movements—and subjective perceptions of presence and copresence. Specifically, the introduction of a perceived risk of actual collision was found to significantly impact global navigation strategies and increase the sense of presence. Auditory cues had a similar effect on global navigation and additionally enhanced the sense of copresence. In contrast, vibrotactile feedback was primarily effective in influencing local movements., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 860768 (CLIPE project), and from MCIN/AEI/10.13039/501100011033/FEDER, UE (PID2021- 122136OB-C21), ”A way to make Europe”. Jose Luis Ponton was also funded by the Spanish Ministry of Universities (FPU21/01927)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Stretch your reach: studying self-avatar and controller misalignment in virtual reality interaction

  • Pontón Martínez, José Luis|||0000-0001-6576-4528
  • Keshavarz, Reza
  • Beacco Porres, Alejandro|||0000-0001-8192-1431
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
Immersive Virtual Reality typically requires a head-mounted display (HMD) to visualize the environment and hand-held controllers to interact with the virtual objects. Recently, many applications display full-body avatars to represent the user and animate the arms to follow the controllers. Embodiment is higher when the self-avatar movements align correctly with the user. However, having a full-body self-avatar following the user’s movements can be challenging due to the disparities between the virtual body and the user’s body. This can lead to misalignments in the hand position that can be noticeable when interacting with virtual objects. In this work, we propose five different interaction modes to allow the user to interact with virtual objects despite the self-avatar and controller misalignment and study their influence on embodiment, proprioception, preference, and task performance. We modify aspects such as whether the virtual controllers are rendered, whether controllers are rendered in their real physical location or attached to the user’s hand, and whether stretching the avatar arms to always reach the real controllers. We evaluate the interaction modes both quantitatively (performance metrics) and qualitatively (embodiment, proprioception, and user preference questionnaires). Our results show that the stretching arms solution, which provides body continuity and guarantees that the virtual hands or controllers are in the correct location, offers the best results in embodiment, user preference, proprioception, and performance. Also, rendering the controller does not have an effect on either embodiment or user preference., This work has received funding from the European Union’sHorizon 2020 research and innovation programme under HORIZON-CL42022-HUMAN-01 grant agreement No 101093159 (XR4ED), and from MCIN/AEI/10.13039/501100011033/FEDER "A way to make Europe", UE (PID2021-122136OB-C21). Jose Luis Ponton was also funded by the Spanish Ministry of Universities (FPU21/01927)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Evaluating the suitability of long document embeddings for classification tasks: a comparative analysis

  • Rafieian, Bardia
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
Long documents pose a significant challenge for natural language processing (NLP), which requires high-quality embeddings. Despite the numerous approaches that encompass both deep learning and machine learning methodologies, tackling this task remains hard. In our study, we tackle the issue of long document classification by leveraging recent advancements in machine learning and deep learning. We conduct a comprehensive evaluation of several state-of-the-art models, including Doc2vec, Longformer, LLaMA-3, and SciBERT, focusing on their effectiveness in handling long to very long documents (in number of tokens). Furthermore, we trained a Doc2vec model using a massive dataset, achieving state-of-the-art quality, and surpassing other methods such as Longformer and SciBERT, which are very costly to train. Notably, while LLaMA-3 outperforms our model in certain aspects, Doc2vec remains highly competitive, particularly in speed, as it is the fastest among the evaluated methods. Through exp erimentation, we thoroughly evaluate the performance of our custom-trained Doc2vec model in classifying documents with an extensive number of tokens, demonstrating its efficacy, especially in handling very long documents. However, our analysis also uncovers inconsistencies in the performance of all models when faced with documents containing larger text volumes., This project has been supported by PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovacion, by 839 FEDER (EU) funds., Peer Reviewed, Objectius de Desenvolupament Sostenible::9 - Indústria, Innovació i Infraestructura
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Reconstructing lost altarpieces: a differentiable rendering approach

  • Pagès Vilà, Anna
  • Muñoz Pandiella, Imanol|||0000-0002-4781-7574
Studying works that have completely or partially disappeared is always difficult due to the lack of information. In more fortunate scenarios where photographs were taken before the destruction, the study of the piece is limited by the viewpoints captured in the available photographs. In this interdisciplinary research, we present a new methodology for reconstructing lost altarpieces from a single historical image, utilizing differentiable rendering techniques. We test our methodology by reconstructing some reliefs from the altarpiece of Sant Joan Baptista (Valls, Spain), which was destroyed in 1936. These results are valuable for both experts and the public, as they facilitate a better understanding of the relief's volumetrics and their spatial relationships, representing a significant advancement in the virtual recovery of lost artifacts., This work has been partially supported by the projects PID2021-122136OB-C21andPID2021-122136OB-C22fundedby MCIN/AEI/ 10.13039/501100011033 and by FEDER A way of making Europe, by the project PID2020-114339GB-C21 funded by the MCIN/AEI, and by the Department of Research and Universities of the Generalitat de Catalunya (2021 SGR 01035)., This work has been partially supported by the projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and by FEDER A way of making Europe, by the project PID2020-114339GB-C21 funded by the MCIN/AEI, and by the Department of Research and Universities of the Generalitat de Catalunya (2021 SGR 01035)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Simulation of mechanical weathering for modeling rocky terrains

  • Mateos Arlanzón, Diego
  • Carranza Cobeñas, Luis Alberto|||0009-0008-8545-148X
  • Susín Sánchez, Antonio|||0000-0002-0874-2784
  • Argudo Medrano, Óscar|||0000-0003-3943-1839
Synthetic terrains play a vital role in various applications, including entertainment, training, and simulation. This work focuses on rocky terrains akin to those found in alpine environments, which contain many complex features such as sharp ridges, loose blocks, or overhangs that are often inadequately represented by standard 2D elevation maps. We propose a novel method based on a simplified simulation of mechanical erosion processes commonly observed in high-altitude terrains, in particular the weathering due to freeze-thaw cycles. The ultimate objective is to generate plausible rocky geometry from existing 3D models, as well as account for the temporal evolution due to these weathering processes. Additionally, we have developed an artist-friendly tool integrated as an add-on into Blender., This work has been funded with Grant PID2021-122136OB-C21 funded by MICIU/AEI/10.13039/501100011033 and ERDF/EU, and with the support of the Department of Research and Universi- ties of the Government of Catalonia (2021 SGR 01035). Luis Carranza was supported with Grant PRE2022-102912 funded by MI- CIU/AEI/10.13039/501100011033 and ESF+, and Oscar Argudo with a Maria Zambrano fellowship from Ministerio de Universidades and European Union—NextGenerationEU., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Rediscovering mural paintings: experiencing medieval art as originally conceived through historical light simulation

  • Muñoz Pandiella, Imanol|||0000-0002-4781-7574
  • Kaur Singh, Manvir
  • Bosch Geli, Carles
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Pueyo Sandez, Francesc Xavier|||0000-0002-3622-583X
The lighting of Cultural Heritage artifacts plays a crucial role in how we perceive and consequently understand artworks. However, lighting is typically designed to enhance the experience of contemporary visitors, often diverging significantly from the original conditions and techniques under which these works were created. This disconnect between historical and modern lighting conditions makes it difficult to fully understand the original visual experience. This issue is particularly evident in the case of Romanesque paintings, which are now exhibited in well-lit museums, but were originally displayed in dimly lit churches. In this paper, we present a method to bridge this gap, focusing on the paintings of a Romanesque church. We achieve this by simulating the original lighting conditions. Our approach encompasses the entire pipeline, from acquiring data of equivalent historical light sources and computing natural lighting to performing physically based rendering for accurate light simulation. Additionally, we have developed a web application that allows users to inspect and compare the resulting HDR images using different tone mapping and luminance operators. Our work provides a valuable tool for art historians and the general public to explore different lighting hypotheses and gain a deeper understanding of the experience of visiting a medieval church as originally conceived., This work has been partially supported by the projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and by FEDER A way of making Europe, and by the Department of Research and Universities of the Generalitat de Catalunya (2021 SGR 01035)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Evaluating the suitability of long document embeddings for classification tasks: a comparative analysis

  • Rafieian, Bardia
  • Vázquez Alcocer, Pere Pau
Long documents pose a significant challenge for natural language processing (NLP), which requires high-quality embeddings. Despite the numerous approaches that encompass both deep learning and machine learning methodologies, tackling this task remains hard. In our study, we tackle the issue of long document classification by leveraging recent advancements in machine learning and deep learning. We conduct a comprehensive evaluation of several state-of-the-art models, including Doc2vec, Longformer, LLaMA-3, and SciBERT, focusing on their effectiveness in handling long to very long documents (in number of tokens). Furthermore, we trained a Doc2vec model using a massive dataset, achieving state-of-the-art quality, and surpassing other methods such as Longformer and SciBERT, which are very costly to train. Notably, while LLaMA-3 outperforms our model in certain aspects, Doc2vec remains highly competitive, particularly in speed, as it is the fastest among the evaluated methods. Through exp erimentation, we thoroughly evaluate the performance of our custom-trained Doc2vec model in classifying documents with an extensive number of tokens, demonstrating its efficacy, especially in handling very long documents. However, our analysis also uncovers inconsistencies in the performance of all models when faced with documents containing larger text volumes., This project has been supported by PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovacion, by 839 FEDER (EU) funds., Peer Reviewed, Objectius de Desenvolupament Sostenible::9 - Indústria, Innovació i Infraestructura, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Effect of color palettes in heatmaps perception: a study

  • Molina López, Elena
  • Middel Soria, Carolina
  • Vázquez Alcocer, Pere Pau
Heatmaps are a widely used technique in visualization. Unfortunately, they have not been investigated in depth and little is known about the best parameterizations so that they are properly interpreted. The effect of different palettes on our ability to read values is still unknown. To address this issue, we conducted a user study, in which we analyzed the effect of two commonly used color palettes, Blues and Viridis, on value estimation and value search. As a result, we provide some suggestions for what to expect from the heatmap configurations analyzed., This paper has been supported by PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovación, by 839 FEDER (EU) funds. Elena Molina has been supported by FI-SDUR doctoral grant from Generalitat de Catalunya, and FPU grant from the Ministerio de Ciencia e Innovación., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

An interaction metaphor for enhanced VR-based volume segmentation

  • Monclús Lahoya, Eva
  • Vázquez Alcocer, Pere Pau
The segmentation of medical models is a complex and time-intensive process required for both diagnosis and surgical preparation. Despite the advancements in deep learning, neural networks can only automatically segment a limited number of structures, often requiring further validation by a domain expert. In numerous instances, manual segmentation is still necessary. Virtual Reality (VR) technology can enhance the segmentation process by providing improved perception of segmentation outcomes and enabling interactive supervision by experts. But inspecting how the progress of the segmentation algorithm is evolving, and defining new seeds requires seeing the inner layers of the volume, which can be costly and difficult to achieve with typical metaphors such as clipping planes. In this paper, we introduce a wedge-shaped 3D interaction metaphor designed to facilitate VR-based segmentation through detailed inspection and guidance. User evaluations demonstrated increased satisfaction with usability and faster task completion times using the tool., Research funded by PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovación, Spain, by 839 FEDER (EU) funds., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Visual analysis of multi-labelled temporal noise data from multiple sensors

  • Franco Moreno, Juan José
  • Vázquez Alcocer, Pere Pau
Environmental noise pollution is a problem for cities’ inhabitants, that can be especially severe in large cities. To implement measures that can alleviate this problem, it is necessary to understand the extent and impact of different noise sources. Although gathering data is relatively cheap, processing and analyzing the data is still complex. Besides the lack of an automatic method for labelling city sounds, maybe more important is the fact that there is not a tool that allows domain experts to analytically explore data that has been manually labelled. To solve this problem, we have created a visual analytics application that facilitates the exploration of multiple-labelled temporal data captured at four different corners of a crossing in a populated area of Barcelona, the Eixample neighborhood. Our tool consists of a series of linked interactive views that facilitate top-down (from noise events to labels) and bottom-up (from labels to time slots) exploration of the captured data., This project has been supported by grants TIN2017-88515-C2-1-R (GEN3DLIVE) from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds, and PID2021-122136OB-C21 from MCIN/AEI/10.13039/501100011033/FEDER, EU., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Bidirectional exploration of 3D cultural heritage models and photo collections

  • Borràs Civil, Bernat
  • Muñoz Pandiella, Imanol
  • Andújar Gran, Carlos Antonio
Advances in 3D digitization have greatly improved the availability of high-quality cultural heritage datasets, often consisting of 3D models and collections of high-resolution photos. However, navigating these 3D datasets poses challenges for art history researchers, especially when they need to repeatedly locate points of interest, get close-up views of them, and analyze their spatial relationships. Existing applications for 3D model sharing often fail to provide a convenient interface to simultaneously explore the 3D model and associated photo collections. This paper proposes a web-based approach that combines a 3D view of the model with a 2D view of a group of photos. Designers can quickly arrange groups of images into 2D projections, and cultural heritage users can explore the 3D model and, simultaneously, the active group of images in the 2D view. Both views are interlinked, so that navigating the 3D model modifies the active photo group, and clicking an image in the 2D view moves the 3D camera to the 3D position the image was taken from. We tested our approach with a 3D dataset on medieval mural paintings. Our tests show that our method helps users quickly locate, inspect and relate different parts of the model, reducing navigation time and frustration. The source code is available at https://github.com/BernatBC/visualitzador-de-fotografies-en-3D., This work has been partially supported by the project PID2021-122136OBC21 funded by MCIN/AEI/ 10.13039/501100011033 and ERDF "A way of making Europe", and by the Department of Research and Universities of the Government of Catalonia (2021 SGR 01035)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Exploring the role of expected collision feedback in crowded virtual environments

  • Yun, Haoran
  • Pontón Martínez, José Luis
  • Beacco Porres, Alejandro
  • Andújar Gran, Carlos Antonio
  • Pelechano Gómez, Núria
An increasing number of virtual reality applications require environments that emulate real-world conditions. These environments often involve dynamic virtual humans showing realistic behaviors. Understanding user perception and navigation among these virtual agents is key for designing realistic and effective environments featuring groups of virtual humans. While collision risk significantly influences human locomotion in the real world, this risk is largely absent in virtual settings. This paper studies the impact of the expected collision feedback on user perception and interaction with virtual crowds. We examine the effectiveness of commonly used collision feedback techniques (auditory cues and tactile vibrations) as well as inducing participants to expect that a physical bump with a real person might occur, as if some virtual humans actually correspond to real persons embodied into them and sharing the same physical space. Our results indicate that the expected collision feedback significantly influences both participant behavior—encompassing global navigation and local movements—and subjective perceptions of presence and copresence. Specifically, the introduction of a perceived risk of actual collision was found to significantly impact global navigation strategies and increase the sense of presence. Auditory cues had a similar effect on global navigation and additionally enhanced the sense of copresence. In contrast, vibrotactile feedback was primarily effective in influencing local movements., This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 860768 (CLIPE project), and from MCIN/AEI/10.13039/501100011033/FEDER, UE (PID2021- 122136OB-C21), ”A way to make Europe”. Jose Luis Ponton was also funded by the Spanish Ministry of Universities (FPU21/01927)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Accurate molecular atom selection in VR

  • Molina López, Elena
  • Vázquez Alcocer, Pere Pau
Target acquisition is a basic task that is part of almost any high-level interaction in 3D environments. Therefore, providing accurate selection is a necessity for most applications and games. When targets are small and scenes are cluttered, selection becomes inaccurate. This may lead to selecting the wrong elements which, apart from the time consumed, may become a frustrating experience. Besides the unintentional tremor, the button/trigger press for effectively selecting an element further reduces our stability, increasing the probability of an incorrect target acquisition. In this paper, we focus on molecular visualization and address the problem of selecting atoms, which are rendered as small spheres. We build upon previous progressive selection algorithms and present two alternatives that accelerate the selection of neighbors after an initial selection. We have implemented and analyzed such techniques through a formal user study and found that they were highly appreciated by the users. These selection methods may be suitable for other crowded environments beyond molecular visualization., This paper has been supported by TIN2017-88515-C2-1- R (GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad and PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovación, by 839 FEDER (EU) funds. Elena Molina has been supported by FI-SDUR doctoral grant from Generalitat de Catalunya, and FPU grant from the Ministerio de Ciencia e Innovación., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Enriching medieval 4D models with interactive narratives

  • Andújar Gran, Carlos Antonio
  • Cayuela Vellido, Begoña
  • Lorès Otzet, Immaculada
  • Bosch Geli, Carles
  • Guardia Pons, Milagros
  • Muñoz Pandiella, Imanol
Digital technologies are increasingly used in cultural heritage preservation and dissemination, but some monuments pose significant challenges due to substantial historical architectural and pictorial changes. This paper introduces a method to enrich multi-layered, multi-phase 3D models of cultural heritage with art history knowledge. This is achieved through imagebased annotations, interactive narratives, points of interest, text, and audio, creating guided tours of the monument's historical phases. The approach is user-friendly for art historians, requiring no programming skills for defining such elements. A pilot user evaluation demonstrated its effectiveness in enhancing visitor engagement and understanding, and allowed improving the final web-based application and narratives., This work has been partially supported by projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and ERDF "A way of making Europe", by the EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127), the Spanish Agencia Estatal de Investigación (grant PCI2020-111979) and by the Department of Research and Universities of the Government of Catalonia (2021 SGR 01035)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Reconstructing lost altarpieces: a differentiable rendering approach

  • Pagès Vilà, Anna
  • Muñoz Pandiella, Imanol
Studying works that have completely or partially disappeared is always difficult due to the lack of information. In more fortunate scenarios where photographs were taken before the destruction, the study of the piece is limited by the viewpoints captured in the available photographs. In this interdisciplinary research, we present a new methodology for reconstructing lost altarpieces from a single historical image, utilizing differentiable rendering techniques. We test our methodology by reconstructing some reliefs from the altarpiece of Sant Joan Baptista (Valls, Spain), which was destroyed in 1936. These results are valuable for both experts and the public, as they facilitate a better understanding of the relief's volumetrics and their spatial relationships, representing a significant advancement in the virtual recovery of lost artifacts., This work has been partially supported by the projects PID2021-122136OB-C21andPID2021-122136OB-C22fundedby MCIN/AEI/ 10.13039/501100011033 and by FEDER A way of making Europe, by the project PID2020-114339GB-C21 funded by the MCIN/AEI, and by the Department of Research and Universities of the Generalitat de Catalunya (2021 SGR 01035)., This work has been partially supported by the projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and by FEDER A way of making Europe, by the project PID2020-114339GB-C21 funded by the MCIN/AEI, and by the Department of Research and Universities of the Generalitat de Catalunya (2021 SGR 01035)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Animation fidelity in self-avatars: impact on user performance and sense of agency

  • Yun, Haoran
  • Pontón Martínez, José Luis
  • Andújar Gran, Carlos Antonio
  • Pelechano Gómez, Núria
The use of self-avatars is gaining popularity thanks to affordable VR headsets. Unfortunately, mainstream VR devices often use a small number of trackers and provide low-accuracy animations. Previous studies have shown that the Sense of Embodiment, and in particular the Sense of Agency, depends on the extent to which the avatar's movements mimic the user's movements. However, few works study such effect for tasks requiring a precise interaction with the environment, i.e., tasks that require accurate manipulation, precise foot stepping, or correct body poses. In these cases, users are likely to notice inconsistencies between their self-avatars and their actual pose. In this paper, we study the impact of the animation fidelity of the user avatar on a variety of tasks that focus on arm movement, leg movement and body posture. We compare three different animation techniques: two of them using Inverse Kinematics to reconstruct the pose from sparse input (6 trackers), and a third one using a professional motion capture system with 17 inertial sensors. We evaluate these animation techniques both quantitatively (completion time, unintentional collisions, pose accuracy) and qualitatively (Sense of Embodiment). Our results show that the animation quality affects the Sense of Embodiment. Inertial-based MoCap performs significantly better in mimicking body poses. Surprisingly, IK-based solutions using fewer sensors outperformed MoCap in tasks requiring accurate positioning, which we attribute to the higher latency and the positional drift that causes errors at the end-effectors, which are more noticeable in contact areas such as the feet., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 860768 (CLIPE project) and from MCIN/AEI/10.13039/501100011033/FEDER, UE (PID2021-122136OB-C21). Jose Luis Ponton was also funded by the Spanish Ministry of Universities (FPU21/01927)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Enriching Medieval 4D Models with Interactive Narratives

  • Andujar, Carlos
  • Cayuela Vellido, Begoña
  • Lorés, Immaculada
  • Bosch Geli, Carles
  • Guardia Pons, Milagros
  • Muñoz-Pandiella, Imanol
Digital technologies are increasingly used in cultural heritage preservation and dissemination, but some monuments pose significant challenges due to substantial historical architectural and pictorial changes. This paper introduces a method to enrich multi-layered, multi-phase 3D models of cultural heritage with art history knowledge. This is achieved through imagebased annotations, interactive narratives, points of interest, text, and audio, creating guided tours of the monument’s historical phases. The approach is user-friendly for art historians, requiring no programming skills for defining such elements. A pilot user evaluation demonstrated its effectiveness in enhancing visitor engagement and understanding, and allowed improving the final web-based application and narratives., This work has been partially supported by projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and ERDF "A way of making Europe", by the EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127), the Spanish Agencia Estatal de Investigación (grant PCI2020-111979) and by the Department of Research and Universities of the Government of Catalonia (2021 SGR 01035).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Simulation of mechanical weathering for modeling rocky terrains

  • Mateos Arlanzón, Diego
  • Carranza Cobeñas, Luis Alberto
  • Susín Sánchez, Antonio
  • Argudo Medrano, Óscar
Synthetic terrains play a vital role in various applications, including entertainment, training, and simulation. This work focuses on rocky terrains akin to those found in alpine environments, which contain many complex features such as sharp ridges, loose blocks, or overhangs that are often inadequately represented by standard 2D elevation maps. We propose a novel method based on a simplified simulation of mechanical erosion processes commonly observed in high-altitude terrains, in particular the weathering due to freeze-thaw cycles. The ultimate objective is to generate plausible rocky geometry from existing 3D models, as well as account for the temporal evolution due to these weathering processes. Additionally, we have developed an artist-friendly tool integrated as an add-on into Blender., This work has been funded with Grant PID2021-122136OB-C21 funded by MICIU/AEI/10.13039/501100011033 and ERDF/EU, and with the support of the Department of Research and Universi- ties of the Government of Catalonia (2021 SGR 01035). Luis Carranza was supported with Grant PRE2022-102912 funded by MI- CIU/AEI/10.13039/501100011033 and ESF+, and Oscar Argudo with a Maria Zambrano fellowship from Ministerio de Universidades and European Union—NextGenerationEU., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Are LLMs ready for visualization?

  • Vázquez Alcocer, Pere Pau
© 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Generative models have received a lot of attention in many areas of academia and the industry. Their capabilities span many areas, from the invention of images given a prompt to the generation of concrete code to solve a certain programming issue. These two paradigmatic cases fall within two distinct categories of requirements, ranging from "creativity" to "precision", as characterized by Bing Chat, which employs ChatGPT-4 as its backbone. Visualization practitioners and researchers have wondered to what end one of such systems could accomplish our work in a more efficient way. Several works in the literature have utilized them for the creation of visualizations. And some tools such as Lida, incorporate them as part of their pipeline. Nevertheless, to the authors’ knowledge, no systematic approach for testing their capabilities has been published, which includes both extensive and in-depth evaluation. Our goal is to fill that gap with a systematic approach that analyzes three elements: whether Large Language Models are capable of correctly generating a large variety of charts, what libraries they can deal with effectively, and how far we can go to configure individual charts. To achieve this objective, we initially selected a diverse set of charts, which are commonly utilized in data visualization. We then developed a set of generic prompts that could be used to generate them, and analyzed the performance of different LLMs and libraries. The results include both the set of prompts and the data sources, as well as an analysis of the performance with different configurations., Supported by Ministerio de Ciencia e Innovación/AEI (PID2021-122136OB-C21 by 10.13039/501100011033/FEDER, UE)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Rediscovering mural paintings: experiencing medieval art as originally conceived through historical light simulation

  • Muñoz Pandiella, Imanol
  • Kaur Singh, Manvir
  • Bosch Geli, Carles
  • Andújar Gran, Carlos Antonio
  • Pueyo Sandez, Francesc Xavier
The lighting of Cultural Heritage artifacts plays a crucial role in how we perceive and consequently understand artworks. However, lighting is typically designed to enhance the experience of contemporary visitors, often diverging significantly from the original conditions and techniques under which these works were created. This disconnect between historical and modern lighting conditions makes it difficult to fully understand the original visual experience. This issue is particularly evident in the case of Romanesque paintings, which are now exhibited in well-lit museums, but were originally displayed in dimly lit churches. In this paper, we present a method to bridge this gap, focusing on the paintings of a Romanesque church. We achieve this by simulating the original lighting conditions. Our approach encompasses the entire pipeline, from acquiring data of equivalent historical light sources and computing natural lighting to performing physically based rendering for accurate light simulation. Additionally, we have developed a web application that allows users to inspect and compare the resulting HDR images using different tone mapping and luminance operators. Our work provides a valuable tool for art historians and the general public to explore different lighting hypotheses and gain a deeper understanding of the experience of visiting a medieval church as originally conceived., This work has been partially supported by the projects PID2021-122136OB-C21 and PID2021-122136OB-C22 funded by MCIN/AEI/ 10.13039/501100011033 and by FEDER A way of making Europe, and by the Department of Research and Universities of the Generalitat de Catalunya (2021 SGR 01035)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Stretch your reach: studying self-avatar and controller misalignment in virtual reality interaction

  • Pontón Martínez, José Luis
  • Keshavarz, Reza
  • Beacco Porres, Alejandro
  • Pelechano Gómez, Núria
Immersive Virtual Reality typically requires a head-mounted display (HMD) to visualize the environment and hand-held controllers to interact with the virtual objects. Recently, many applications display full-body avatars to represent the user and animate the arms to follow the controllers. Embodiment is higher when the self-avatar movements align correctly with the user. However, having a full-body self-avatar following the user’s movements can be challenging due to the disparities between the virtual body and the user’s body. This can lead to misalignments in the hand position that can be noticeable when interacting with virtual objects. In this work, we propose five different interaction modes to allow the user to interact with virtual objects despite the self-avatar and controller misalignment and study their influence on embodiment, proprioception, preference, and task performance. We modify aspects such as whether the virtual controllers are rendered, whether controllers are rendered in their real physical location or attached to the user’s hand, and whether stretching the avatar arms to always reach the real controllers. We evaluate the interaction modes both quantitatively (performance metrics) and qualitatively (embodiment, proprioception, and user preference questionnaires). Our results show that the stretching arms solution, which provides body continuity and guarantees that the virtual hands or controllers are in the correct location, offers the best results in embodiment, user preference, proprioception, and performance. Also, rendering the controller does not have an effect on either embodiment or user preference., This work has received funding from the European Union’sHorizon 2020 research and innovation programme under HORIZON-CL42022-HUMAN-01 grant agreement No 101093159 (XR4ED), and from MCIN/AEI/10.13039/501100011033/FEDER "A way to make Europe", UE (PID2021-122136OB-C21). Jose Luis Ponton was also funded by the Spanish Ministry of Universities (FPU21/01927)., Peer Reviewed, Postprint (author's final draft)