Skip to main content

VISUALIZACION, MODELADO, SIMULACION E INTERACCION CON MODELOS 3D. APLICACIONES EN CIENCIAS DE LA VIDA Y ENTORNOS RURALES Y URBANOS

TIN2017-88515-C2-1-R

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos I+D+i Retos de Investigación
Call year 2017
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 60
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

AvatarGo: plug and play self-avatars for VR

  • Pontón Martínez, José Luis|||0000-0001-6576-4528
  • Monclús Lahoya, Eva|||0000-0002-9645-0510
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
The use of self-avatars in a VR application can enhance presence and embodiment which leads to a better user experience. In collaborative VR it also facilitates non-verbal communication. Currently it is possible to track a few body parts with cheap trackers and then apply IK methods to animate a character. However, the correspondence between trackers and avatar joints is typically fixed ad-hoc, which is enough to animate the avatar, but causes noticeable mismatches between the user’s body pose and the avatar. In this paper we present a fast and easy to set up system to compute exact offset values, unique for each user, which leads to improvements in avatar movement. Our user study shows that the Sense of Embodiment increased significantly when using exact offsets as opposed to fixed ones. We also allowed the users to see a semitransparent avatar overlaid with their real body to objectively evaluate the quality of the avatar movement with our technique., This work was funded by the Spanish Ministry of Economy, Industry and Competitiveness (TIN2017-88515-C2-1-R)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Users’ locomotor behavior in collaborative virtual reality

  • Ríos Jerez, Alejandro|||0000-0003-1210-8951
  • Palomar Soler, Marc
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
This paper presents a virtual reality experiment in which two participants share both the virtual and the physical space while performing a collaborative task. We are interested in studying what are the differences in human locomotor behavior between the real world and the VR scenario. For that purpose, participants performed the experiment in both the real and the virtual scenarios. For the VR case, participants can see both their own animated avatar and the avatar of the other participant in the environment. As they move, we store their trajectories to obtain information regarding speeds, clearance distances and task completion times. For the VR scenario, we also wanted to evaluate whether the users were aware of subtle differences in the avatar's animations and foot steps sounds. We ran the same experiment under three different conditions: (1) synchronizing the avatar's feet animation and sound of footsteps with the movement of the participant; (2) synchronizing the animation but not the sound and finally (3) not synchronizing either one. The results show significant differences in user's presence questionnaires and also different trends in their locomotor behavior between the real world and the VR scenarios., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Smooth transitioning between two walking metaphors for virtual reality applications

  • Salvetti, Isadora
  • Ríos Jerez, Alejandro|||0000-0003-1210-8951
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
Virtual navigation should be as similar as possible to how we move in the real world, however the limitations of hardware and physical space make this a challenging problem. Tracking natural walk is only feasible when the dimensions of the virtual environment match those of the real world. The problem of most navigation techniques is that they produce motion sickness because the optical flow observed does not match the vestibular and proprioceptive information that appears during real physical movement. Walk in place is a technique that can successfully reduce motion sickness without losing presence in the virtual environment. It is suitable for navigating in a very large virtual environment but it is not usually needed in small virtual spaces. Most current work focuses on one specific navigation metaphor, however in our experience we have observed that if users are given the possibility to use walk in place for large distances, they tend to switch to normal walk when they are in a confined virtual area (such as a small room). Therefore, in this paper we present our ongoing work to seamlessly switch between two navigation metaphors based on leg and head tracking to achieve a more intuitive and natural virtual navigation., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Depth map repairing for building reconstruction

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Argudo Medrano, Óscar|||0000-0003-3943-1839
  • Besora Vilardaga, Isaac
  • Brunet Crossa, Pere
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Comino Trinidad, Marc|||0000-0001-5621-7565
This is the accepted version of the article which has been published in final form at https://diglib.eg.org/handle/10.2312/ceig20181162. This article may be used for non-commercial purposes in accordance with the Wiley Self-Archiving Policy [http://olabout.wiley.com/WileyCDA/Section/id-820227.html]., Structure-from-motion along with multi-view stereo techniques jointly allow for the inexpensive scanning of 3D objects (e.g. buildings) using just a collection of images taken from commodity cameras. Despite major advances in these fields, a major limitation of dense reconstruction algorithms is that correct depth/normal values are not recovered on specular surfaces (e.g. windows) and parts lacking image features (e.g. flat, textureless parts of the facade). Since these reflective properties are inherent to the surface being acquired, images from different viewpoints hardly contribute to solve this problem. In this paper we present a simple method for detecting, classifying and filling non-valid data regions in depth maps produced by dense stereo algorithms. Triangles meshes reconstructed from our repaired depth maps exhibit much higher quality than those produced by state-of-the-art reconstruction algorithms like Screened Poisson-based techniques., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Easy authoring of image-supported short stories for 3D scanned cultural heritage

  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Visual storytelling is a powerful tool for Cultural Heritage communication. However, traditional authoring tools either produce videos that cannot be fully integrated with 3D scanned models, or require 3D content creation skills that imply a high entry barrier for Cultural Heritage experts. In this paper we present an image-supported, video-based authoring tool allowing non- 3D-experts to create rich narrative content that can be fully integrated in immersive virtual reality experiences. Given an existing 3D scanned model, each story is based on a user-provided photo or system-proposed image. First, the system automatically registers the image against the 3D model, and creates an undistorted version that will serve as a fixed background image for the story. Authors can then use their favorite presentation software to annotate or edit the image while recording their voice. The resulting video is processed automatically to detect per-frame regions-of-interest. At visualization time, videos are projected onto the 3D scanned model, allowing the audience to watch the narrative piece in its surrounding spatial context. We discuss multiple color blending techniques, inspired by detail textures, to provide high-resolution detail. The system uses the image-to-model registration data to find suitable locations for triggers and avatars that draw the user attention towards the 3D model parts being referred to by the presenter. We conducted an informal user study to evaluate the quality of the immersive experience. Our findings suggest that our approach is a valuable tool for fast and easy creation of fully-immersive visual storytelling experiences., This work has been funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, the Spanish Ministry of Education, Culture and Sports PhD grant FPU14/00725, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017-84451-P, Universitat de Barcelona) and the JPICH-0127 EU project Enhancement of Heritage Experiences: the Middle Ages. Digital Layered Models of Architecture and Mural Paintings over Time (EHEM)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

MeshPipe: a Python-based tool for easy automation and demonstration of geometry processing pipelines

  • Fons Sánchez, Joan
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
The popularization of inexpensive 3D scanning, 3D printing, 3D publishing and AR/VR display technologies have renewed the interest in open-source tools providing the geometry processing algorithms required to clean, repair, enrich, optimize and modify point-based and polygonal-based models. Nowadays, there is a large variety of such open-source tools whose user community includes 3D experts but also 3D enthusiasts and professionals from other disciplines. In this paper we present a Python-based tool that addresses two major caveats of current solutions: the lack of easy-to-use methods for the creation of custom geometry processing pipelines (automation), and the lack of a suitable visual interface for quickly testing, comparing and sharing different pipelines, supporting rapid iterations and providing dynamic feedback to the user (demonstration). From the user's point of view, the tool is a 3D viewer with an integrated Python console from which internal or external Python code can be executed. We provide an easy-to-use but powerful API for element selection and geometry processing. Key algorithms are provided by a high-level C library exposed to the viewer via Python-C bindings. Unlike competing open-source alternatives, our tool has a minimal learning curve and typical pipelines can be written in a few lines of Python code., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Intrinsic-extrinsic convolution and pooling for learning on 3D protein structures

  • Hermosilla Casajús, Pedro
  • Schäfer, Marco
  • Lang, Matej
  • Fackelmann, Gloria
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
  • Kozliková, Barbora
  • Krone, Michael
  • Ritschel, Tobias
  • Ropinski, Timo
Proteins perform a large variety of functions in living organisms and thus play a key role in biology. However, commonly used algorithms in protein learning were not specifically designed for protein data, and are therefore not able to capture all relevant structural levels of a protein during learning. To fill this gap, we propose two new learning operators, specifically designed to process protein structures. First, we introduce a novel convolution operator that considers the primary, secondary, and tertiary structure of a protein by using n-D convolutions defined on both the Euclidean distance, as well as multiple geodesic distances between the atoms in a multi-graph. Second, we introduce a set of hierarchical pooling operators that enable multi-scale protein analysis. We further evaluate the accuracy of our algorithms on common downstream tasks, where we outperform state-of-the-art protein learning algorithms., This work was partially funded by the Deutsche Forschungsgemeinschaft (DFG), grant RO 3408/2-1 (ProLint), the project TIN2017-88515-C2-1-R(GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad, and by 839 FEDER (EU) funds, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Accurate molecular atom selection in VR

  • Molina López, Elena|||0000-0003-4561-6215
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
Target acquisition is a basic task that is part of almost any high-level interaction in 3D environments. Therefore, providing accurate selection is a necessity for most applications and games. When targets are small and scenes are cluttered, selection becomes inaccurate. This may lead to selecting the wrong elements which, apart from the time consumed, may become a frustrating experience. Besides the unintentional tremor, the button/trigger press for effectively selecting an element further reduces our stability, increasing the probability of an incorrect target acquisition. In this paper, we focus on molecular visualization and address the problem of selecting atoms, which are rendered as small spheres. We build upon previous progressive selection algorithms and present two alternatives that accelerate the selection of neighbors after an initial selection. We have implemented and analyzed such techniques through a formal user study and found that they were highly appreciated by the users. These selection methods may be suitable for other crowded environments beyond molecular visualization., This paper has been supported by TIN2017-88515-C2-1- R (GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad and PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovación, by 839 FEDER (EU) funds. Elena Molina has been supported by FI-SDUR doctoral grant from Generalitat de Catalunya, and FPU grant from the Ministerio de Ciencia e Innovación., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

A platform for developing and fine tuning adaptive 3D navigation techniques for the immersive web

  • Kamal, Ahmed
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Navigating through a virtual environment is one of the major user tasks in the 3D web. Although hundreds of interaction techniques have been proposed to navigate through 3D scenes in desktop, mobile and VR headset systems, 3D navigation still poses a high entry barrier for many potential users. In this paper we discuss the design and implementation of a test platform to facilitate the creation and fine-tuning of interaction techniques for 3D navigation. We support the most common navigation metaphors (walking, flying, teleportation). The key idea is to let developers specify, at runtime, the exact mapping between user actions and virtual camera changes, for any of the supported metaphors. We demonstrate through many examples how this method can be used to adapt the navigation techniques to various people including persons with no previous 3D navigation skills, elderly people, and people with disabilities., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, by EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Investigación, grant PCI2020-111979 Enhancement of Heritage Experiences: the Middle Ages; Digital Layered Models of Architecture and Mural Paintings over Time (EHEM)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

How should we design violin plots?

  • Molina López, Elena|||0000-0003-4561-6215
  • Viale Herrando, Laia
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
One way to illustrate distributions of samples is through the use of violin plots. The original design is a combination of boxplot and density plot mirrored and plot around the boxplot. However, there are other designs in literature. Although they seem a powerful way to illustrate distributions, the fact that they encode distributions makes them difficult to read. Users have problems comparing two different distributions, and certain basic statistics such as the mean can be difficult to estimate properly. To get more insights on how people interprets violin plots, we have carried out an experiment to analyze how the different configurations affect judgments over values encoded in those plots., This project has been supported by project TIN2017-88515-C2-1- R(GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

VR-assisted architectural design in a heritage site: the Sagrada Família case study

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Brunet Crossa, Pere
  • Buxareu, Jeronimo
  • Fons Sánchez, Joan
  • Laguarda, Narcis
  • Pascual, Jordi
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
Virtual Reality (VR) simulations have long been proposed to allow users to explore both yet-to-built buildings in architectural design, and ancient, remote or disappeared buildings in cultural heritage. In this paper we describe an on-going VR project on an UNESCO World Heritage Site that simultaneously addresses both scenarios: supporting architects in the task of designing the remaining parts of a large unfinished building, and simulating existing parts that define the environment that new designs must conform to. The main challenge for the team of architects is to advance towards the project completion being faithful to the original Gaudí’s project, since many plans, drawings and plaster models were lost. We analyze the main requirements for collaborative architectural design in such a unique scenario, describe the main technical challenges, and discuss the lessons learned after one year of use of the system., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Digital reintegration of distributed mural paintings at different architectural phases: the case of St. Quirze de Pedret

  • Muñoz Pandiella, Imanol|||0000-0002-4781-7574
  • Argudo Medrano, Óscar|||0000-0003-3943-1839
  • Lorès Otzet, Immaculada
  • Font Comas, Joan
  • Àvila Casademont, Genís|||0000-0003-0819-2038
  • Pueyo Sandez, Francesc Xavier|||0000-0002-3622-583X
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Sant Quirze de Pedret is a Romanesque church located in Cercs (Catalonia, Spain) at the foothills of the Pyrenees. Its walls harbored one of the most important examples of mural paintings in Catalan Romanesque Art. However, in two different campaigns (in 1921 and 1937) the paintings were removed using the strappo technique and transferred to museums for safekeeping. This detachment protected the paintings from being sold in the art market, but at the price of breaking the integrity of the monument. Nowadays, the paintings are exhibited in the Museu Nacional d'Art de Catalunya - MNAC (Barcelona, Catalonia) and the Museu Diocesà i Comarcal de Solsona - MDCS (Solsona, Catalonia). Some fragments of the paintings are still on the walls of the church. In this work, we present the methodology to digitally reconstruct the church building at its different phases and group the dispersed paintings in a single virtual church, commissioned by the MDCS. We have combined 3D reconstruction (LIDAR and photogrammetric using portable artificial illumination) and modeling techniques (including texture transfer between different shapes) to recover the integrity of the monument in a single 3D virtual model. Furthermore, we have reconstructed the church building at different significant historical moments and placed actual paintings on its virtual walls, based on archaeological knowledge. This set of 3D models allows experts and visitors to better understand the monument as a whole, the relations between the different paintings, and its evolution over time., The project has been promoted by the Museu Diocesà i Comarcal de Solsona (special thanks are due to Carles Freixes and Lídia Fàbregas), co-financed by "La Caixa" Foundation and the Department of Culture of the Generalitat de Catalunya. Likewise, the work presented here counted with the support of MEIC (Spanish Government) project 3D4LIFE (TIN-2017-88515-C2), PRECA II of the Universitat de Barcelona (HAR2017-84451-P) and EHEM (JPICH0127 Conservation, Protection and Use, PCI2020-111979). The high-resolution photographs of the paintings are by Gaetano Alfano (Università degli Studi della Tuscia)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

GL-Socket: A CG plugin-based framework for teaching and assessment

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Fairén González, Marta|||0000-0001-7293-584X
  • Vinacua Pla, Álvaro|||0000-0001-8984-4311
In this paper we describe a plugin-based C++ framework for teaching OpenGL and GLSL in introductory Computer Graphics courses. The main strength of the framework architecture is that student assignments are mostly independent and thus can be completed, tested and evaluated in any order. When students complete a task, the plugin interface forces a clear separation of initialization, interaction and drawing code, which in turn facilitates code reusability. Plugin code can access scene, camera, and OpenGL window methods through a simple API. The plugin interface is flexible enough to allow students to complete tasks requiring shader development, object drawing, and multiple rendering passes. Students are provided with sample plugins with basic scene drawing and camera control features. One of the plugins that the students receive contains a shader development framework with self-assessment features. We describe the lessons learned after using the tool for four years in a Computer Graphics course involving more than one hundred Computer Science students per year., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Improving perception of molecular surface visualizations by incorporating translucency effects

  • Hermosilla Casajús, Pedro
  • Maisch, Sebastian
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
  • Ropinski, Timo
Molecular surfaces are a commonly used representation in the analysis of molecular structures as they provide a compact description of the space occupied by a molecule and its accessibility. However, due to the high abstraction of the atomic data, fine grain features are hard to identify. Moreover, these representations involve a high degree of occlusions, which prevents the identification of internal features and potentially impacts shape perception. In this paper, we present a set of techniques which are inspired by the properties of translucent materials, that have been developed to improve the perception of molecular surfaces: First, we introduce an interactive algorithm to simulate subsurface scattering for molecular surfaces, in order to improve the thickness perception of the molecule. Second, we present a technique to visualize structures just beneath the surface, by still conveying relevant depth information. And lastly, we introduce reflections and refractions into our visualization that improve the shape perception of molecular surfaces. We evaluate the benefits of these methods through crowd-sourced user studies as well as the feedback from several domain experts., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Visual analysis of environmental noise data

  • Franco Moreno, Juan José
  • Alsina Pagès, Rosa Maria
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
Smart cities generate a large amount of information that, if used properly, can help improve people's quality of life, while providing environmental support. Decreasing pollution generated by noise, is a prevailing concern, in today's society. A group of experts has collected data in different areas of l'Escaldes-Engordany, in Andorra. These areas have been separated according to traffic policies, i.e., the fully pedestrian ones, the fully vehicular ones, and the combined ones. Analyzing the resulting data may be a complex task, where optimal tools are not available; hence, we have developed a visualization application that allows comparisons and analysis. The main purpose is to improve the conditions in decision making, by having accurate information so that policymakers may have a better understanding of how different transit levels configure the noise landscape, and how contrasting sounds are distributed throughout time. To achieve this, we have developed a visualization application that allows overviewing, detailed individual analysis, and comparative views to parameterize the results of the policies adopted and be in a better position to improve them., Partially supported by project TIN2017-88515-C2-1-R(GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds. Juan José Franco Moreno is supported by Consejo Nacional de Ciencia y Tecnología (CONACYT, Mexico)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

An annotation tool for digital restoration of wall paintings

  • Barreiro Díaz, Albert
  • Muñoz Pandiella, Imanol|||0000-0002-4781-7574
  • Bosch Geli, Carles
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Antique paintings are essential to study and understand our past. Paintings, and specifically mural paintings, are delicate artworks that are affected by multiple deterioration conditions. Weathering and human interventions cause different damage problems, and physical and chemical changes degrade their visual color appearance. As a consequence, art historians and archaeologists require a huge effort to attempt to rebuild their original appearance. The annotation of digital images of the paintings is a valuable tool in this process. In this paper we analyze major requirements from art historians concerning the annotation of painting regions from the point of view of digital restoration. We also describe a tool prototype (based on TagLab) intended to facilitate the annotation and segmentation of mural paintings. The tool assists art historians in formulating multiple hypotheses on the original appearance by supporting multiple annotation layers for degradation and color, providing both hand-drawn and semi-automatic segmentation, and offering web-based dissemination and sharing of the annotations through the W3C Web Annotation Data Model., This work has been partially supported by the projects TIN2017-88515-C2-1-R/-2-R funded by MCIN/AEI/ 10.13039/501100011033/ FEDER “A way to make Europe”,by the EUHorizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Invesigación (grant PCI2020-111979)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

An automatic tool to facilitate authoring animation blending in game engines

  • Delicado Alcántara, Luis
  • Pelechano Gómez, Núria|||0000-0002-1437-245X
Achieving realistic virtual humans is crucial in virtual reality applications and video games. Nowadays there are software and game development tools, that are of great help to generate and simulate characters. They offer easy to use GUIs to create characters by dragging and drooping features, and making small modifications. Similarly, there are tools to create animation graphs and setting blending parameters among others. Unfortunately, even though these tools are relatively user friendly, achieving natural animation transitions is not straight forward and thus non-expert users tend to spend a large amount of time to generate animations that are not completely free of artefacts. In this paper we present a method to automatically generate animation blend spaces in Unreal engine, which offers two advantages: the first one is that it provides a tool to evaluate the quality of an animation set, and the second one is that the resulting graph does not depend on user skills and it is thus not prone to user errors., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

A virtual reality front-end for city modeling

  • Randó Segura, Eduard|||0000-0002-4089-1165
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Patow, Gustavo Ariel|||0000-0002-1977-9101
Current tools for city modeling, including those supporting procedural techniques, have a steep learning curve and require substantial user input and/or skills to create realistic 3D models of cities. In this paper we propose a VR tool for the fast and intuitive creation of 3D models of cities through their main elements (buildings, blocks and streets). The key ingredients of our approach are: (a) intuitive creation of mass volume models for buildings, whose facades can be refined later on through procedural rules, (b) the ability to use arbitrary urban layouts, either created from scratch within the tool or imported from public map services, (c) algorithms to replicate and transfer user-generated blocks to arbitrary block shapes, so that a few template blocks suffice to cover the whole urban layout. The major benefit of our approach is that city design and inspection tasks are done simultaneously in a completely immersive environment., This work was partially funded by the TIN2017-88515-C2-1-R and TIN2017-88515-C2-2-R projects from Ministerio de Economía y Competitividad, Spain., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

A Web-based application for the visual exploration of colon morphology data

  • Males, Jan
  • Monclús Lahoya, Eva|||0000-0002-9645-0510
  • Díaz Iriberri, José
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
The colon is an organ whose constant motility poses difficulties to its analysis. Although morphological data can be successfully extracted from Computational Tomography, its radiative nature makes it only indicated for patients with disorders. Only recently, acquisition techniques that rely on the use of Magnetic Resonance Imaging have matured enough to enable the generation of morphological colon data of healthy patients without preparation (i. e. administration of drugs or contrast agents). As a result, a database of colon morphological data for patients under different diets, has been created. Currently, the digestologists we collaborate with analyze the measured data of the gut by inspecting a set of spreadsheets. In this paper, we propose a system for the exploratory visual analysis of the whole database of morphological data at once. It provides features for the visual comparison of data correlations, the inspection of the morphological measures, as well 3D rendering of the colon segmented models. The system solely relies on the use of web technologies, which makes it portable even to mobile devices., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Immersive geometry-based and image-based exploration of cultural heritage models

  • Farràs Llobet, Arnau
  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Recent advances in 3D acquisition technologies have facilitated the inexpensive digitization of cultural heritage. In addition to the 3D digital model, in many cases multiple photo collections are also available. These photo collections often provide valuable information not included in the 3D digital model. In this paper we describe a VR-ready web application to simultaneously explore a cultural heritage model together with arbitrary photo collections. At any time, users can define a region of interest either explicitly or implicitly, and the application retrieves, scores, groups and shows a matching subset of the photos. Users can then select a photo to project it onto the 3D model, to inspect the photo separately, or to teleport to the position the photo was taken from. Unlike previous approaches for joint 2D-3D model exploration, our interface has been specifically adapted to VR. We conducted a user study and found that the application greatly facilitates navigation and provides a fast, intuitive access to the available photos. The application supports any modern browser running on desktop, mobile and VR headset systems., The digitization of the St. Quirze de Pedret models was partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grants TIN2017-88515-C2-1-R, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017-84451-P, Universitat de Barcelona) and the JPICH0127 EU project Enhancement of Heritage Experiences: the Middle Ages; Digital Layered Models of Architecture and Mural Paintings over Time (EHEM)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Visual analysis of multi-labelled temporal noise data from multiple sensors

  • Franco Moreno, Juan José
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
Environmental noise pollution is a problem for cities’ inhabitants, that can be especially severe in large cities. To implement measures that can alleviate this problem, it is necessary to understand the extent and impact of different noise sources. Although gathering data is relatively cheap, processing and analyzing the data is still complex. Besides the lack of an automatic method for labelling city sounds, maybe more important is the fact that there is not a tool that allows domain experts to analytically explore data that has been manually labelled. To solve this problem, we have created a visual analytics application that facilitates the exploration of multiple-labelled temporal data captured at four different corners of a crossing in a populated area of Barcelona, the Eixample neighborhood. Our tool consists of a series of linked interactive views that facilitate top-down (from noise events to labels) and bottom-up (from labels to time slots) exploration of the captured data., This project has been supported by grants TIN2017-88515-C2-1-R (GEN3DLIVE) from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds, and PID2021-122136OB-C21 from MCIN/AEI/10.13039/501100011033/FEDER, EU., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Improving perception accuracy in bar charts with internal contrast and framing enhancements

  • Díaz Iriberri, José
  • Meruvia Pastor, Oscar
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
Bar charts are among the most commonly used visualization graphs. Their main goal is to communicate quantities that can be visually compared. Since they are easy to produce and interpret, they are found in any situation where quantitative data needs to be conveyed (websites, newspapers, etc.). However, depending on the layout, the perceived values can vary substantially. For instance, previous research has shown that the positioning of bars (e.g. stacked vs separate) may influence the accuracy in bar ratio length estimation. Other works have studied the effects of embellishments on the perception of encoded quantities. However, to the best of the authors’ knowledge, the effect of perceptual elements used to reinforce the quantity depicted within the bars, such as contrast and inner lines, has not been studied in depth. In this research we present a study that analyzes the effect of several internal contrast and framing enhancements with respect to the use of basic solid bars. Our results show that the addition of minimal visual elements that are easy to implement with current technology can help users to better recognize the amounts depicted by the bar charts., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Effective visualization of sparse image-to-image correspondences

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Comino Trinidad, Marc|||0000-0001-5621-7565
Finding robust correspondences between images is a crucial step in photogrammetry applications. The traditional approach to visualize sparse matches between two images is to place them side-by-side and draw link segments connecting pixels with matching features. In this paper we present new visualization techniques for sparse correspondences between image pairs. Key ingredients of our techniques include (a) the clustering of consistent matches, (b) the optimization of the image layout to minimize occlusions due to the super-imposed links, (c) a color mapping to minimize color interference among links (d) a criterion for giving visibility priority to isolated links, (e) the bending of link segments to put apart nearby links, and (f) the use of glyphs to facilitate the identification of matching keypoints. We show that our technique substantially reduces the clutter in the final composite image and thus makes it easier to detect and inspect both inlier and outlier matches. Potential applications include the validation of image pairs in difficult setups and the visual comparison of feature detection / matching algorithms., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grant TIN2017-88515-C2-1-R., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

A Parser-based tool to assist instructors in grading computer graphics assignments

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Vijulie, Cristina Raluca
  • Vinacua Pla, Álvaro|||0000-0001-8984-4311
Although online e-learning environments are increasingly used in university courses, manual assessment still dominates the way students are graded. Interactive judges providing a pass/fail verdict based on test sets are valuable tools both for learning and assessment, but still rely on human review of the code for output-independent issues such as readability and efficiency. In this paper we present a tool to assist instructors in grading programming exercises in Computer Graphics (CG) courses. In contrast to other grading solutions, assessment is based both on checking the output against test sets, and through a set of instructor-defined rubrics based on syntax analysis of the source code. Our current prototype runs in Python and supports the assessment of shaders written in GLSL language. We tested the tool in a CG course involving more than one hundred Computer Science students per year. Our first experiments show the tool can be useful to support both self-assessment and grading, as well as detecting grading mistakes through anomaly detection techniques based on features extracted from the syntax analysis., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grant TIN2017-88515-C2-1-R., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

View-dependent hierarchical rendering of massive point clouds through textured splats

  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
Nowadays, there are multiple available range scanning technologies which can capture extremely detailed models of realworld surfaces. The result of such process is usually a set of point clouds which can contain billions of points. While these point clouds can be used and processed offline for a variety of purposes (such as surface reconstruction and offline rendering) it is unfeasible to interactively visualize the raw point data. The most common approach is to use a hierarchical representation to render varying-size oriented splats, but this method also has its limitations as usually a single color is encoded for each point sample. Some authors have proposed the use of color-textured splats, but these either have been designed for offline rendering or do not address the efficient encoding of image datasets into textures. In this work, we propose extending point clouds by encoding their color information into textures and using a pruning and scaling rendering algorithm to achieve interactive rendering. Our approach can be combined with hierarchical point-based representations to allow for real-time rendering of massive point clouds in commodity hardware., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Colonic content assessment from MRI imaging using a semi-automatic approach

  • Ceballos Inza, Víctor
  • Monclús Lahoya, Eva|||0000-0002-9645-0510
  • Vázquez Alcocer, Pere Pau|||0000-0003-4638-4065
  • Bendezú García, Álvaro
  • Mego Silva, Marianela
  • Merino Casabiel, Xavier
  • Azpiroz Vidaur, Fernando
  • Navazo Álvaro, Isabel|||0000-0001-6298-1463
The analysis of the morphology and content of the gut is necessary in order to achieve a better understanding of its metabolic and functional activity. Magnetic resonance imaging (MRI) has become an important imaging technique since it is able to visualize soft tissues in an undisturbed bowel using no ionizing radiation. In the last few years, MRI of gastrointestinal function has advanced substantially. However, few studies have focused on the colon, because the analysis of colonic content is time consuming and cumbersome. This paper presents a semi-automatic segmentation tool for the quantitative assessment of the unprepared colon from MRI images. The techniques developed here have been crucial for a number of clinical experiments., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

A Tool for N-way analysis of programming exercises

  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Fairén González, Marta|||0000-0001-7293-584X
  • Vinacua Pla, Álvaro|||0000-0001-8984-4311
Programming exercises are a corner stone in Computer Science courses. If used properly, these exercises provide valuable feedback both to students and instructors. Unfortunately, the assessment of student submissions through code inspection requires a considerable amount of time. In this work we present an interactive tool to support the analysis of code submissions before, during, and after grading. The key idea is to compute a dissimilarity matrix for code submissions, using a metric that incorporates syntactic, semantic and functional aspects of the code. This matrix is used to embed the submissions in 2D space, so that similar submissions are mapped to nearby locations. The tool allows users to visually identify clusters, inspect individual submissions, and perform detailed pair-wise and abridged n-way comparisons. Finally, our approach facilitates comparative scoring by presenting submissions in a nearly-optimal order, i.e. similar submissions appear close in the sequence. Our initial evaluation indicates that the tool (currently supporting C++/GLSL code) provides clear benefits both to students (more fair scores, less bias, more consistent feedback) and instructors (less effort, better feedback on student performance)., This work has been funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grant TIN2017-88515-C2-1-R., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Neural colorization of laser scans

  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Bosch Geli, Carles
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Muñoz-Pandiella, Imanol
Laser scanners enable the digitization of 3D surfaces by generating a point cloud where each point sample includes an intensity (infrared reflectivity) value. Some LiDAR scanners also incorporate cameras to capture the color of the surfaces visible from the scanner location. Getting usable colors everywhere across 360° scans is a challenging task, especially for indoor scenes. LiDAR scanners lack flashes, and placing proper light sources for a 360° indoor scene is either unfeasible or undesirable. As a result, color data from LiDAR scans often do not have an adequate quality, either because of poor exposition (too bright or too dark areas) or because of severe illumination changes between scans (e.g. direct Sunlight vs cloudy lighting). In this paper, we present a new method to recover plausible color data from the infrared data available in LiDAR scans. The main idea is to train an adapted image-to-image translation network using color and intensity values on well-exposed areas of scans. At inference time, the network is able to recover plausible color using exclusively the intensity values. The immediate application of our approach is the selective colorization of LiDAR data in those scans or regions with missing or poor color data., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017- 84451-P, UB) and by the EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Invesigación (grant PCI2020-111979)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Multi-view image fusion

  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Martin Brualla, Ricardo
  • Kainz, Florian
  • Kontkanen, Janne
We present an end-to-end learned system for fusing multiple misaligned photographs of the same scene into a chosen target view. We demonstrate three use cases: 1) color transfer for inferring color for a monochrome view, 2) HDR fusion for merging misaligned bracketed exposures, and 3) detail transfer for reprojecting a high definition image to the point of view of an affordable VR180-camera. While the system can be trained end-to-end, it consists of three distinct steps: feature extraction, image warping and fusion. We present a novel cascaded feature extraction method that enables us to synergetically learn optical flow at different resolution levels. We show that this significantly improves the network’s ability to learn large disparities. Finally, we demonstrate that our alignment architecture outperforms a state-of-the art optical flow network on the image warping task when both systems are trained in an identical manner., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Intensity-guided exposure correction for indoor LiDAR scans

  • Comino Trinidad, Marc|||0000-0001-5621-7565
  • Andújar Gran, Carlos Antonio|||0000-0002-8480-4713
  • Bosch Geli, Carles
  • Chica Calaf, Antonio|||0000-0003-0270-2332
  • Muñoz-Pandiella, Imanol
Terrestrial Laser Scanners, also known as LiDAR, are often equipped with color cameras so that both infrared and RGB values are measured for each point sample. High-end scanners also provide panoramic High Dynamic Range (HDR) images. Rendering such HDR colors on conventional displays requires a tone-mapping operator, and getting a suitable exposure everywhere on the image can be challenging for 360° indoor scenes with a variety of rooms and illumination sources. In this paper we present a simple-to-implement tone mapping algorithm for HDR panoramas captured by LiDAR equipment. The key idea is to choose, on a per-pixel basis, an exposure correction factor based on the local intensity (infrared reflectivity). Since LiDAR intensity values for indoor scenes are nearly independent from the external illumination, we show that intensity-guided exposure correction often outperforms state-of-the-art tone-mapping operators on this kind of scenes., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017-84451-P, UB) and by EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Invesigación (grant PCI2020-111979). The authors would like to thank Prof. Xavier Pueyo for his helpful comments., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A Tool for N-way analysis of programming exercises

  • Andújar Gran, Carlos Antonio
  • Comino Trinidad, Marc
  • Fairén González, Marta
  • Vinacua Pla, Álvaro
Programming exercises are a corner stone in Computer Science courses. If used properly, these exercises provide valuable feedback both to students and instructors. Unfortunately, the assessment of student submissions through code inspection requires a considerable amount of time. In this work we present an interactive tool to support the analysis of code submissions before, during, and after grading. The key idea is to compute a dissimilarity matrix for code submissions, using a metric that incorporates syntactic, semantic and functional aspects of the code. This matrix is used to embed the submissions in 2D space, so that similar submissions are mapped to nearby locations. The tool allows users to visually identify clusters, inspect individual submissions, and perform detailed pair-wise and abridged n-way comparisons. Finally, our approach facilitates comparative scoring by presenting submissions in a nearly-optimal order, i.e. similar submissions appear close in the sequence. Our initial evaluation indicates that the tool (currently supporting C++/GLSL code) provides clear benefits both to students (more fair scores, less bias, more consistent feedback) and instructors (less effort, better feedback on student performance)., This work has been funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grant TIN2017-88515-C2-1-R., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A virtual reality front-end for city modeling

  • Randó Segura, Eduard
  • Andújar Gran, Carlos Antonio
  • Patow, Gustavo Ariel
Current tools for city modeling, including those supporting procedural techniques, have a steep learning curve and require substantial user input and/or skills to create realistic 3D models of cities. In this paper we propose a VR tool for the fast and intuitive creation of 3D models of cities through their main elements (buildings, blocks and streets). The key ingredients of our approach are: (a) intuitive creation of mass volume models for buildings, whose facades can be refined later on through procedural rules, (b) the ability to use arbitrary urban layouts, either created from scratch within the tool or imported from public map services, (c) algorithms to replicate and transfer user-generated blocks to arbitrary block shapes, so that a few template blocks suffice to cover the whole urban layout. The major benefit of our approach is that city design and inspection tasks are done simultaneously in a completely immersive environment., This work was partially funded by the TIN2017-88515-C2-1-R and TIN2017-88515-C2-2-R projects from Ministerio de Economía y Competitividad, Spain., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Improving perception accuracy in bar charts with internal contrast and framing enhancements

  • Díaz Iriberri, José
  • Meruvia Pastor, Oscar
  • Vázquez Alcocer, Pere Pau
Bar charts are among the most commonly used visualization graphs. Their main goal is to communicate quantities that can be visually compared. Since they are easy to produce and interpret, they are found in any situation where quantitative data needs to be conveyed (websites, newspapers, etc.). However, depending on the layout, the perceived values can vary substantially. For instance, previous research has shown that the positioning of bars (e.g. stacked vs separate) may influence the accuracy in bar ratio length estimation. Other works have studied the effects of embellishments on the perception of encoded quantities. However, to the best of the authors’ knowledge, the effect of perceptual elements used to reinforce the quantity depicted within the bars, such as contrast and inner lines, has not been studied in depth. In this research we present a study that analyzes the effect of several internal contrast and framing enhancements with respect to the use of basic solid bars. Our results show that the addition of minimal visual elements that are easy to implement with current technology can help users to better recognize the amounts depicted by the bar charts., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Digital reintegration of distributed mural paintings at different architectural phases: the case of St. Quirze de Pedret

  • Muñoz Pandiella, Imanol
  • Argudo Medrano, Óscar
  • Lorès Otzet, Immaculada
  • Font Comas, Joan
  • Àvila Casademont, Genís
  • Pueyo Sandez, Francesc Xavier
  • Andújar Gran, Carlos Antonio
Sant Quirze de Pedret is a Romanesque church located in Cercs (Catalonia, Spain) at the foothills of the Pyrenees. Its walls harbored one of the most important examples of mural paintings in Catalan Romanesque Art. However, in two different campaigns (in 1921 and 1937) the paintings were removed using the strappo technique and transferred to museums for safekeeping. This detachment protected the paintings from being sold in the art market, but at the price of breaking the integrity of the monument. Nowadays, the paintings are exhibited in the Museu Nacional d'Art de Catalunya - MNAC (Barcelona, Catalonia) and the Museu Diocesà i Comarcal de Solsona - MDCS (Solsona, Catalonia). Some fragments of the paintings are still on the walls of the church. In this work, we present the methodology to digitally reconstruct the church building at its different phases and group the dispersed paintings in a single virtual church, commissioned by the MDCS. We have combined 3D reconstruction (LIDAR and photogrammetric using portable artificial illumination) and modeling techniques (including texture transfer between different shapes) to recover the integrity of the monument in a single 3D virtual model. Furthermore, we have reconstructed the church building at different significant historical moments and placed actual paintings on its virtual walls, based on archaeological knowledge. This set of 3D models allows experts and visitors to better understand the monument as a whole, the relations between the different paintings, and its evolution over time., The project has been promoted by the Museu Diocesà i Comarcal de Solsona (special thanks are due to Carles Freixes and Lídia Fàbregas), co-financed by "La Caixa" Foundation and the Department of Culture of the Generalitat de Catalunya. Likewise, the work presented here counted with the support of MEIC (Spanish Government) project 3D4LIFE (TIN-2017-88515-C2), PRECA II of the Universitat de Barcelona (HAR2017-84451-P) and EHEM (JPICH0127 Conservation, Protection and Use, PCI2020-111979). The high-resolution photographs of the paintings are by Gaetano Alfano (Università degli Studi della Tuscia)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A Parser-based tool to assist instructors in grading computer graphics assignments

  • Andújar Gran, Carlos Antonio
  • Vijulie, Cristina Raluca
  • Vinacua Pla, Álvaro
Although online e-learning environments are increasingly used in university courses, manual assessment still dominates the way students are graded. Interactive judges providing a pass/fail verdict based on test sets are valuable tools both for learning and assessment, but still rely on human review of the code for output-independent issues such as readability and efficiency. In this paper we present a tool to assist instructors in grading programming exercises in Computer Graphics (CG) courses. In contrast to other grading solutions, assessment is based both on checking the output against test sets, and through a set of instructor-defined rubrics based on syntax analysis of the source code. Our current prototype runs in Python and supports the assessment of shaders written in GLSL language. We tested the tool in a CG course involving more than one hundred Computer Science students per year. Our first experiments show the tool can be useful to support both self-assessment and grading, as well as detecting grading mistakes through anomaly detection techniques based on features extracted from the syntax analysis., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grant TIN2017-88515-C2-1-R., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Visual analysis of multi-labelled temporal noise data from multiple sensors

  • Franco Moreno, Juan José
  • Vázquez Alcocer, Pere Pau
Environmental noise pollution is a problem for cities’ inhabitants, that can be especially severe in large cities. To implement measures that can alleviate this problem, it is necessary to understand the extent and impact of different noise sources. Although gathering data is relatively cheap, processing and analyzing the data is still complex. Besides the lack of an automatic method for labelling city sounds, maybe more important is the fact that there is not a tool that allows domain experts to analytically explore data that has been manually labelled. To solve this problem, we have created a visual analytics application that facilitates the exploration of multiple-labelled temporal data captured at four different corners of a crossing in a populated area of Barcelona, the Eixample neighborhood. Our tool consists of a series of linked interactive views that facilitate top-down (from noise events to labels) and bottom-up (from labels to time slots) exploration of the captured data., This project has been supported by grants TIN2017-88515-C2-1-R (GEN3DLIVE) from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds, and PID2021-122136OB-C21 from MCIN/AEI/10.13039/501100011033/FEDER, EU., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A Web-based application for the visual exploration of colon morphology data

  • Males, Jan
  • Monclús Lahoya, Eva
  • Díaz Iriberri, José
  • Vázquez Alcocer, Pere Pau
The colon is an organ whose constant motility poses difficulties to its analysis. Although morphological data can be successfully extracted from Computational Tomography, its radiative nature makes it only indicated for patients with disorders. Only recently, acquisition techniques that rely on the use of Magnetic Resonance Imaging have matured enough to enable the generation of morphological colon data of healthy patients without preparation (i. e. administration of drugs or contrast agents). As a result, a database of colon morphological data for patients under different diets, has been created. Currently, the digestologists we collaborate with analyze the measured data of the gut by inspecting a set of spreadsheets. In this paper, we propose a system for the exploratory visual analysis of the whole database of morphological data at once. It provides features for the visual comparison of data correlations, the inspection of the morphological measures, as well 3D rendering of the colon segmented models. The system solely relies on the use of web technologies, which makes it portable even to mobile devices., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Neural colorization of laser scans

  • Comino Trinidad, Marc
  • Andújar Gran, Carlos Antonio
  • Bosch Geli, Carles
  • Chica Calaf, Antonio
  • Muñoz-Pandiella, Imanol
Laser scanners enable the digitization of 3D surfaces by generating a point cloud where each point sample includes an intensity (infrared reflectivity) value. Some LiDAR scanners also incorporate cameras to capture the color of the surfaces visible from the scanner location. Getting usable colors everywhere across 360° scans is a challenging task, especially for indoor scenes. LiDAR scanners lack flashes, and placing proper light sources for a 360° indoor scene is either unfeasible or undesirable. As a result, color data from LiDAR scans often do not have an adequate quality, either because of poor exposition (too bright or too dark areas) or because of severe illumination changes between scans (e.g. direct Sunlight vs cloudy lighting). In this paper, we present a new method to recover plausible color data from the infrared data available in LiDAR scans. The main idea is to train an adapted image-to-image translation network using color and intensity values on well-exposed areas of scans. At inference time, the network is able to recover plausible color using exclusively the intensity values. The immediate application of our approach is the selective colorization of LiDAR data in those scans or regions with missing or poor color data., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017- 84451-P, UB) and by the EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Invesigación (grant PCI2020-111979)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

AvatarGo: plug and play self-avatars for VR

  • Pontón Martínez, José Luis
  • Monclús Lahoya, Eva
  • Pelechano Gómez, Núria
The use of self-avatars in a VR application can enhance presence and embodiment which leads to a better user experience. In collaborative VR it also facilitates non-verbal communication. Currently it is possible to track a few body parts with cheap trackers and then apply IK methods to animate a character. However, the correspondence between trackers and avatar joints is typically fixed ad-hoc, which is enough to animate the avatar, but causes noticeable mismatches between the user’s body pose and the avatar. In this paper we present a fast and easy to set up system to compute exact offset values, unique for each user, which leads to improvements in avatar movement. Our user study shows that the Sense of Embodiment increased significantly when using exact offsets as opposed to fixed ones. We also allowed the users to see a semitransparent avatar overlaid with their real body to objectively evaluate the quality of the avatar movement with our technique., This work was funded by the Spanish Ministry of Economy, Industry and Competitiveness (TIN2017-88515-C2-1-R)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Intrinsic-extrinsic convolution and pooling for learning on 3D protein structures

  • Hermosilla Casajús, Pedro
  • Schäfer, Marco
  • Lang, Matej
  • Fackelmann, Gloria
  • Vázquez Alcocer, Pere Pau
  • Kozliková, Barbora
  • Krone, Michael
  • Ritschel, Tobias
  • Ropinski, Timo
Proteins perform a large variety of functions in living organisms and thus play a key role in biology. However, commonly used algorithms in protein learning were not specifically designed for protein data, and are therefore not able to capture all relevant structural levels of a protein during learning. To fill this gap, we propose two new learning operators, specifically designed to process protein structures. First, we introduce a novel convolution operator that considers the primary, secondary, and tertiary structure of a protein by using n-D convolutions defined on both the Euclidean distance, as well as multiple geodesic distances between the atoms in a multi-graph. Second, we introduce a set of hierarchical pooling operators that enable multi-scale protein analysis. We further evaluate the accuracy of our algorithms on common downstream tasks, where we outperform state-of-the-art protein learning algorithms., This work was partially funded by the Deutsche Forschungsgemeinschaft (DFG), grant RO 3408/2-1 (ProLint), the project TIN2017-88515-C2-1-R(GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad, and by 839 FEDER (EU) funds, Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

An annotation tool for digital restoration of wall paintings

  • Barreiro Díaz, Albert
  • Muñoz Pandiella, Imanol
  • Bosch Geli, Carles
  • Andújar Gran, Carlos Antonio
Antique paintings are essential to study and understand our past. Paintings, and specifically mural paintings, are delicate artworks that are affected by multiple deterioration conditions. Weathering and human interventions cause different damage problems, and physical and chemical changes degrade their visual color appearance. As a consequence, art historians and archaeologists require a huge effort to attempt to rebuild their original appearance. The annotation of digital images of the paintings is a valuable tool in this process. In this paper we analyze major requirements from art historians concerning the annotation of painting regions from the point of view of digital restoration. We also describe a tool prototype (based on TagLab) intended to facilitate the annotation and segmentation of mural paintings. The tool assists art historians in formulating multiple hypotheses on the original appearance by supporting multiple annotation layers for degradation and color, providing both hand-drawn and semi-automatic segmentation, and offering web-based dissemination and sharing of the annotations through the W3C Web Annotation Data Model., This work has been partially supported by the projects TIN2017-88515-C2-1-R/-2-R funded by MCIN/AEI/ 10.13039/501100011033/ FEDER “A way to make Europe”,by the EUHorizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Invesigación (grant PCI2020-111979)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Depth map repairing for building reconstruction

  • Andújar Gran, Carlos Antonio
  • Argudo Medrano, Óscar
  • Besora Vilardaga, Isaac
  • Brunet Crossa, Pere
  • Chica Calaf, Antonio
  • Comino Trinidad, Marc
This is the accepted version of the article which has been published in final form at https://diglib.eg.org/handle/10.2312/ceig20181162. This article may be used for non-commercial purposes in accordance with the Wiley Self-Archiving Policy [http://olabout.wiley.com/WileyCDA/Section/id-820227.html]., Structure-from-motion along with multi-view stereo techniques jointly allow for the inexpensive scanning of 3D objects (e.g. buildings) using just a collection of images taken from commodity cameras. Despite major advances in these fields, a major limitation of dense reconstruction algorithms is that correct depth/normal values are not recovered on specular surfaces (e.g. windows) and parts lacking image features (e.g. flat, textureless parts of the facade). Since these reflective properties are inherent to the surface being acquired, images from different viewpoints hardly contribute to solve this problem. In this paper we present a simple method for detecting, classifying and filling non-valid data regions in depth maps produced by dense stereo algorithms. Triangles meshes reconstructed from our repaired depth maps exhibit much higher quality than those produced by state-of-the-art reconstruction algorithms like Screened Poisson-based techniques., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Accurate molecular atom selection in VR

  • Molina López, Elena
  • Vázquez Alcocer, Pere Pau
Target acquisition is a basic task that is part of almost any high-level interaction in 3D environments. Therefore, providing accurate selection is a necessity for most applications and games. When targets are small and scenes are cluttered, selection becomes inaccurate. This may lead to selecting the wrong elements which, apart from the time consumed, may become a frustrating experience. Besides the unintentional tremor, the button/trigger press for effectively selecting an element further reduces our stability, increasing the probability of an incorrect target acquisition. In this paper, we focus on molecular visualization and address the problem of selecting atoms, which are rendered as small spheres. We build upon previous progressive selection algorithms and present two alternatives that accelerate the selection of neighbors after an initial selection. We have implemented and analyzed such techniques through a formal user study and found that they were highly appreciated by the users. These selection methods may be suitable for other crowded environments beyond molecular visualization., This paper has been supported by TIN2017-88515-C2-1- R (GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad and PID2021-122136OB-C21 from the Ministerio de Ciencia e Innovación, by 839 FEDER (EU) funds. Elena Molina has been supported by FI-SDUR doctoral grant from Generalitat de Catalunya, and FPU grant from the Ministerio de Ciencia e Innovación., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Improving perception of molecular surface visualizations by incorporating translucency effects

  • Hermosilla Casajús, Pedro
  • Maisch, Sebastian
  • Vázquez Alcocer, Pere Pau
  • Ropinski, Timo
Molecular surfaces are a commonly used representation in the analysis of molecular structures as they provide a compact description of the space occupied by a molecule and its accessibility. However, due to the high abstraction of the atomic data, fine grain features are hard to identify. Moreover, these representations involve a high degree of occlusions, which prevents the identification of internal features and potentially impacts shape perception. In this paper, we present a set of techniques which are inspired by the properties of translucent materials, that have been developed to improve the perception of molecular surfaces: First, we introduce an interactive algorithm to simulate subsurface scattering for molecular surfaces, in order to improve the thickness perception of the molecule. Second, we present a technique to visualize structures just beneath the surface, by still conveying relevant depth information. And lastly, we introduce reflections and refractions into our visualization that improve the shape perception of molecular surfaces. We evaluate the benefits of these methods through crowd-sourced user studies as well as the feedback from several domain experts., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Smooth transitioning between two walking metaphors for virtual reality applications

  • Salvetti, Isadora
  • Ríos Jerez, Alejandro
  • Pelechano Gómez, Núria
Virtual navigation should be as similar as possible to how we move in the real world, however the limitations of hardware and physical space make this a challenging problem. Tracking natural walk is only feasible when the dimensions of the virtual environment match those of the real world. The problem of most navigation techniques is that they produce motion sickness because the optical flow observed does not match the vestibular and proprioceptive information that appears during real physical movement. Walk in place is a technique that can successfully reduce motion sickness without losing presence in the virtual environment. It is suitable for navigating in a very large virtual environment but it is not usually needed in small virtual spaces. Most current work focuses on one specific navigation metaphor, however in our experience we have observed that if users are given the possibility to use walk in place for large distances, they tend to switch to normal walk when they are in a confined virtual area (such as a small room). Therefore, in this paper we present our ongoing work to seamlessly switch between two navigation metaphors based on leg and head tracking to achieve a more intuitive and natural virtual navigation., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Multi-view image fusion

  • Comino Trinidad, Marc
  • Martin Brualla, Ricardo
  • Kainz, Florian
  • Kontkanen, Janne
We present an end-to-end learned system for fusing multiple misaligned photographs of the same scene into a chosen target view. We demonstrate three use cases: 1) color transfer for inferring color for a monochrome view, 2) HDR fusion for merging misaligned bracketed exposures, and 3) detail transfer for reprojecting a high definition image to the point of view of an affordable VR180-camera. While the system can be trained end-to-end, it consists of three distinct steps: feature extraction, image warping and fusion. We present a novel cascaded feature extraction method that enables us to synergetically learn optical flow at different resolution levels. We show that this significantly improves the network’s ability to learn large disparities. Finally, we demonstrate that our alignment architecture outperforms a state-of-the art optical flow network on the image warping task when both systems are trained in an identical manner., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

VR-assisted architectural design in a heritage site: the Sagrada Família case study

  • Andújar Gran, Carlos Antonio
  • Brunet Crossa, Pere
  • Buxareu, Jeronimo
  • Fons Sánchez, Joan
  • Laguarda, Narcis
  • Pascual, Jordi
  • Pelechano Gómez, Núria
Virtual Reality (VR) simulations have long been proposed to allow users to explore both yet-to-built buildings in architectural design, and ancient, remote or disappeared buildings in cultural heritage. In this paper we describe an on-going VR project on an UNESCO World Heritage Site that simultaneously addresses both scenarios: supporting architects in the task of designing the remaining parts of a large unfinished building, and simulating existing parts that define the environment that new designs must conform to. The main challenge for the team of architects is to advance towards the project completion being faithful to the original Gaudí’s project, since many plans, drawings and plaster models were lost. We analyze the main requirements for collaborative architectural design in such a unique scenario, describe the main technical challenges, and discuss the lessons learned after one year of use of the system., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A platform for developing and fine tuning adaptive 3D navigation techniques for the immersive web

  • Kamal, Ahmed
  • Andújar Gran, Carlos Antonio
Navigating through a virtual environment is one of the major user tasks in the 3D web. Although hundreds of interaction techniques have been proposed to navigate through 3D scenes in desktop, mobile and VR headset systems, 3D navigation still poses a high entry barrier for many potential users. In this paper we discuss the design and implementation of a test platform to facilitate the creation and fine-tuning of interaction techniques for 3D navigation. We support the most common navigation metaphors (walking, flying, teleportation). The key idea is to let developers specify, at runtime, the exact mapping between user actions and virtual camera changes, for any of the supported metaphors. We demonstrate through many examples how this method can be used to adapt the navigation techniques to various people including persons with no previous 3D navigation skills, elderly people, and people with disabilities., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, by EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Investigación, grant PCI2020-111979 Enhancement of Heritage Experiences: the Middle Ages; Digital Layered Models of Architecture and Mural Paintings over Time (EHEM)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Easy authoring of image-supported short stories for 3D scanned cultural heritage

  • Comino Trinidad, Marc
  • Chica Calaf, Antonio
  • Andújar Gran, Carlos Antonio
Visual storytelling is a powerful tool for Cultural Heritage communication. However, traditional authoring tools either produce videos that cannot be fully integrated with 3D scanned models, or require 3D content creation skills that imply a high entry barrier for Cultural Heritage experts. In this paper we present an image-supported, video-based authoring tool allowing non- 3D-experts to create rich narrative content that can be fully integrated in immersive virtual reality experiences. Given an existing 3D scanned model, each story is based on a user-provided photo or system-proposed image. First, the system automatically registers the image against the 3D model, and creates an undistorted version that will serve as a fixed background image for the story. Authors can then use their favorite presentation software to annotate or edit the image while recording their voice. The resulting video is processed automatically to detect per-frame regions-of-interest. At visualization time, videos are projected onto the 3D scanned model, allowing the audience to watch the narrative piece in its surrounding spatial context. We discuss multiple color blending techniques, inspired by detail textures, to provide high-resolution detail. The system uses the image-to-model registration data to find suitable locations for triggers and avatars that draw the user attention towards the 3D model parts being referred to by the presenter. We conducted an informal user study to evaluate the quality of the immersive experience. Our findings suggest that our approach is a valuable tool for fast and easy creation of fully-immersive visual storytelling experiences., This work has been funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, the Spanish Ministry of Education, Culture and Sports PhD grant FPU14/00725, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017-84451-P, Universitat de Barcelona) and the JPICH-0127 EU project Enhancement of Heritage Experiences: the Middle Ages. Digital Layered Models of Architecture and Mural Paintings over Time (EHEM)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Visual analysis of environmental noise data

  • Franco Moreno, Juan José
  • Alsina Pagès, Rosa Maria
  • Vázquez Alcocer, Pere Pau
Smart cities generate a large amount of information that, if used properly, can help improve people's quality of life, while providing environmental support. Decreasing pollution generated by noise, is a prevailing concern, in today's society. A group of experts has collected data in different areas of l'Escaldes-Engordany, in Andorra. These areas have been separated according to traffic policies, i.e., the fully pedestrian ones, the fully vehicular ones, and the combined ones. Analyzing the resulting data may be a complex task, where optimal tools are not available; hence, we have developed a visualization application that allows comparisons and analysis. The main purpose is to improve the conditions in decision making, by having accurate information so that policymakers may have a better understanding of how different transit levels configure the noise landscape, and how contrasting sounds are distributed throughout time. To achieve this, we have developed a visualization application that allows overviewing, detailed individual analysis, and comparative views to parameterize the results of the policies adopted and be in a better position to improve them., Partially supported by project TIN2017-88515-C2-1-R(GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds. Juan José Franco Moreno is supported by Consejo Nacional de Ciencia y Tecnología (CONACYT, Mexico)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

How should we design violin plots?

  • Molina López, Elena
  • Viale Herrando, Laia
  • Vázquez Alcocer, Pere Pau
One way to illustrate distributions of samples is through the use of violin plots. The original design is a combination of boxplot and density plot mirrored and plot around the boxplot. However, there are other designs in literature. Although they seem a powerful way to illustrate distributions, the fact that they encode distributions makes them difficult to read. Users have problems comparing two different distributions, and certain basic statistics such as the mean can be difficult to estimate properly. To get more insights on how people interprets violin plots, we have carried out an experiment to analyze how the different configurations affect judgments over values encoded in those plots., This project has been supported by project TIN2017-88515-C2-1- R(GEN3DLIVE), from the Spanish Ministerio de Economía y Competitividad, by 839 FEDER (EU) funds., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

View-dependent hierarchical rendering of massive point clouds through textured splats

  • Comino Trinidad, Marc
  • Chica Calaf, Antonio
  • Andújar Gran, Carlos Antonio
Nowadays, there are multiple available range scanning technologies which can capture extremely detailed models of realworld surfaces. The result of such process is usually a set of point clouds which can contain billions of points. While these point clouds can be used and processed offline for a variety of purposes (such as surface reconstruction and offline rendering) it is unfeasible to interactively visualize the raw point data. The most common approach is to use a hierarchical representation to render varying-size oriented splats, but this method also has its limitations as usually a single color is encoded for each point sample. Some authors have proposed the use of color-textured splats, but these either have been designed for offline rendering or do not address the efficient encoding of image datasets into textures. In this work, we propose extending point clouds by encoding their color information into textures and using a pruning and scaling rendering algorithm to achieve interactive rendering. Our approach can be combined with hierarchical point-based representations to allow for real-time rendering of massive point clouds in commodity hardware., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

GL-Socket: A CG plugin-based framework for teaching and assessment

  • Andújar Gran, Carlos Antonio
  • Chica Calaf, Antonio
  • Fairén González, Marta
  • Vinacua Pla, Álvaro
In this paper we describe a plugin-based C++ framework for teaching OpenGL and GLSL in introductory Computer Graphics courses. The main strength of the framework architecture is that student assignments are mostly independent and thus can be completed, tested and evaluated in any order. When students complete a task, the plugin interface forces a clear separation of initialization, interaction and drawing code, which in turn facilitates code reusability. Plugin code can access scene, camera, and OpenGL window methods through a simple API. The plugin interface is flexible enough to allow students to complete tasks requiring shader development, object drawing, and multiple rendering passes. Students are provided with sample plugins with basic scene drawing and camera control features. One of the plugins that the students receive contains a shader development framework with self-assessment features. We describe the lessons learned after using the tool for four years in a Computer Graphics course involving more than one hundred Computer Science students per year., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

An automatic tool to facilitate authoring animation blending in game engines

  • Delicado Alcántara, Luis
  • Pelechano Gómez, Núria
Achieving realistic virtual humans is crucial in virtual reality applications and video games. Nowadays there are software and game development tools, that are of great help to generate and simulate characters. They offer easy to use GUIs to create characters by dragging and drooping features, and making small modifications. Similarly, there are tools to create animation graphs and setting blending parameters among others. Unfortunately, even though these tools are relatively user friendly, achieving natural animation transitions is not straight forward and thus non-expert users tend to spend a large amount of time to generate animations that are not completely free of artefacts. In this paper we present a method to automatically generate animation blend spaces in Unreal engine, which offers two advantages: the first one is that it provides a tool to evaluate the quality of an animation set, and the second one is that the resulting graph does not depend on user skills and it is thus not prone to user errors., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

MeshPipe: a Python-based tool for easy automation and demonstration of geometry processing pipelines

  • Fons Sánchez, Joan
  • Chica Calaf, Antonio
  • Andújar Gran, Carlos Antonio
The popularization of inexpensive 3D scanning, 3D printing, 3D publishing and AR/VR display technologies have renewed the interest in open-source tools providing the geometry processing algorithms required to clean, repair, enrich, optimize and modify point-based and polygonal-based models. Nowadays, there is a large variety of such open-source tools whose user community includes 3D experts but also 3D enthusiasts and professionals from other disciplines. In this paper we present a Python-based tool that addresses two major caveats of current solutions: the lack of easy-to-use methods for the creation of custom geometry processing pipelines (automation), and the lack of a suitable visual interface for quickly testing, comparing and sharing different pipelines, supporting rapid iterations and providing dynamic feedback to the user (demonstration). From the user's point of view, the tool is a 3D viewer with an integrated Python console from which internal or external Python code can be executed. We provide an easy-to-use but powerful API for element selection and geometry processing. Key algorithms are provided by a high-level C library exposed to the viewer via Python-C bindings. Unlike competing open-source alternatives, our tool has a minimal learning curve and typical pipelines can be written in a few lines of Python code., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Effective visualization of sparse image-to-image correspondences

  • Andújar Gran, Carlos Antonio
  • Chica Calaf, Antonio
  • Comino Trinidad, Marc
Finding robust correspondences between images is a crucial step in photogrammetry applications. The traditional approach to visualize sparse matches between two images is to place them side-by-side and draw link segments connecting pixels with matching features. In this paper we present new visualization techniques for sparse correspondences between image pairs. Key ingredients of our techniques include (a) the clustering of consistent matches, (b) the optimization of the image layout to minimize occlusions due to the super-imposed links, (c) a color mapping to minimize color interference among links (d) a criterion for giving visibility priority to isolated links, (e) the bending of link segments to put apart nearby links, and (f) the use of glyphs to facilitate the identification of matching keypoints. We show that our technique substantially reduces the clutter in the final composite image and thus makes it easier to detect and inspect both inlier and outlier matches. Potential applications include the validation of image pairs in difficult setups and the visual comparison of feature detection / matching algorithms., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grant TIN2017-88515-C2-1-R., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Intensity-guided exposure correction for indoor LiDAR scans

  • Comino Trinidad, Marc
  • Andújar Gran, Carlos Antonio
  • Bosch Geli, Carles
  • Chica Calaf, Antonio
  • Muñoz-Pandiella, Imanol
Terrestrial Laser Scanners, also known as LiDAR, are often equipped with color cameras so that both infrared and RGB values are measured for each point sample. High-end scanners also provide panoramic High Dynamic Range (HDR) images. Rendering such HDR colors on conventional displays requires a tone-mapping operator, and getting a suitable exposure everywhere on the image can be challenging for 360° indoor scenes with a variety of rooms and illumination sources. In this paper we present a simple-to-implement tone mapping algorithm for HDR panoramas captured by LiDAR equipment. The key idea is to choose, on a per-pixel basis, an exposure correction factor based on the local intensity (infrared reflectivity). Since LiDAR intensity values for indoor scenes are nearly independent from the external illumination, we show that intensity-guided exposure correction often outperforms state-of-the-art tone-mapping operators on this kind of scenes., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER under grant TIN2017-88515-C2-1-R, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017-84451-P, UB) and by EU Horizon 2020, JPICH Conservation, Protection and Use initiative (JPICH-0127) and the Spanish Agencia Estatal de Invesigación (grant PCI2020-111979). The authors would like to thank Prof. Xavier Pueyo for his helpful comments., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Immersive geometry-based and image-based exploration of cultural heritage models

  • Farràs Llobet, Arnau
  • Comino Trinidad, Marc
  • Andújar Gran, Carlos Antonio
Recent advances in 3D acquisition technologies have facilitated the inexpensive digitization of cultural heritage. In addition to the 3D digital model, in many cases multiple photo collections are also available. These photo collections often provide valuable information not included in the 3D digital model. In this paper we describe a VR-ready web application to simultaneously explore a cultural heritage model together with arbitrary photo collections. At any time, users can define a region of interest either explicitly or implicitly, and the application retrieves, scores, groups and shows a matching subset of the photos. Users can then select a photo to project it onto the 3D model, to inspect the photo separately, or to teleport to the position the photo was taken from. Unlike previous approaches for joint 2D-3D model exploration, our interface has been specifically adapted to VR. We conducted a user study and found that the application greatly facilitates navigation and provides a fast, intuitive access to the available photos. The application supports any modern browser running on desktop, mobile and VR headset systems., The digitization of the St. Quirze de Pedret models was partially funded by the Spanish Ministry of Economy and Competitiveness and FEDER Grants TIN2017-88515-C2-1-R, the Romanesque Pyrenees, Space of Artistic Confluences II (PRECA II) project (HAR2017-84451-P, Universitat de Barcelona) and the JPICH0127 EU project Enhancement of Heritage Experiences: the Middle Ages; Digital Layered Models of Architecture and Mural Paintings over Time (EHEM)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Colonic content assessment from MRI imaging using a semi-automatic approach

  • Ceballos Inza, Víctor
  • Monclús Lahoya, Eva
  • Vázquez Alcocer, Pere Pau
  • Bendezú García, Álvaro
  • Mego Silva, Marianela
  • Merino Casabiel, Xavier
  • Azpiroz Vidaur, Fernando
  • Navazo Álvaro, Isabel
The analysis of the morphology and content of the gut is necessary in order to achieve a better understanding of its metabolic and functional activity. Magnetic resonance imaging (MRI) has become an important imaging technique since it is able to visualize soft tissues in an undisturbed bowel using no ionizing radiation. In the last few years, MRI of gastrointestinal function has advanced substantially. However, few studies have focused on the colon, because the analysis of colonic content is time consuming and cumbersome. This paper presents a semi-automatic segmentation tool for the quantitative assessment of the unprepared colon from MRI images. The techniques developed here have been crucial for a number of clinical experiments., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Users’ locomotor behavior in collaborative virtual reality

  • Ríos Jerez, Alejandro
  • Palomar Soler, Marc
  • Pelechano Gómez, Núria
This paper presents a virtual reality experiment in which two participants share both the virtual and the physical space while performing a collaborative task. We are interested in studying what are the differences in human locomotor behavior between the real world and the VR scenario. For that purpose, participants performed the experiment in both the real and the virtual scenarios. For the VR case, participants can see both their own animated avatar and the avatar of the other participant in the environment. As they move, we store their trajectories to obtain information regarding speeds, clearance distances and task completion times. For the VR scenario, we also wanted to evaluate whether the users were aware of subtle differences in the avatar's animations and foot steps sounds. We ran the same experiment under three different conditions: (1) synchronizing the avatar's feet animation and sound of footsteps with the movement of the participant; (2) synchronizing the animation but not the sound and finally (3) not synchronizing either one. The results show significant differences in user's presence questionnaires and also different trends in their locomotor behavior between the real world and the VR scenarios., Peer Reviewed, Postprint (published version)