Pasar al contenido principal

PULIDO ROBOTIZADO AVANZADO DE SUPERFICIES EN LA INDUSTRIA DEL AUTOMOVIL

PID2020-117421RB-C21

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITÈCNICA DE VALÈNCIA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 19
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Advanced teleoperation and control system for industrial robots based on augmented virtuality and haptic feedback

  • González, Claudia
  • Girbés-Juan, Vicent
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] There are some industrial tasks that are still mainly performed manually by human workers due to their complexity, which is the case of surface treatment operations (such as sanding, deburring, finishing, grinding, polishing, etc.) used to repair defects. This work develops an advanced teleoperation and control system for industrial robots in order to assist the human operator to perform the mentioned tasks. On the one hand, the controlled robotic system provides strength and accuracy, holding the tool, keeping the right tool orientation and guaranteeing a smooth approach to the workpiece. On the other hand, the advanced teleoperation provides security and comfort to the user when performing the task. In particular, the proposed teleoperation uses augmented virtuality (i.e., a virtual world that includes non-modeled real-world data) and haptic feedback to provide the user an immersive virtual experience when remotely teleoperating the tool of the robot system to treat arbitrary regions of the workpiece surface. The method is illustrated with a car body surface treatment operation, although it can be easily extended to other surface treatment applications or even to other industrial tasks where the human operator may benefit from robotic assistance. The effectiveness of the proposed approach is shown with several experiments using a 6R robotic arm. Moreover, a comparison of the performance obtained manually by an expert and that obtained with the proposed method has also been conducted in order to show the suitability of the proposed approach., This research was founded by the Spanish Government and the Generalitat Valenciana under Grants PID2020-117421RB-C21 and GV/2021/005
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

  • Girbés-Juan, Vicent
  • Schettino, Vinicius
  • Demiris, Yiannis
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method., This research was funded by Generalitat Valenciana (Grants GV/2021/074 and GV/2021/181) and by the SpanishGovernment (Grants PID2020-118071GB-I00 and PID2020-117421RBC21 funded by MCIN/AEI/10.13039/501100011033). This work was also supported byCoordenacao de Aperfeiaoamento de Pessoal de Nivel Superior (CAPES Brasil) under Finance Code 001, by CEFET-MG, and by a Royal Academy of Engineering Chair in Emerging Technologies to YD.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Cooperative human-robot polishing for the task of patina growing on high-quality leather shoes

  • Borrell, Jorge
  • González, Alejandra
  • Pérez-Vidal, Carlos
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
[EN] A patina is essentially the weathered look a piece of leather takes on as it ages. The patina finishing aspect can be also generated or grown artificially by scrubbing the leather surface with specific products. These kinds of manual finishing operations on small objects are delicate and regularly need slight corrections carried out by skilled artisans, which adds complexity to the process automation and implies various key aspects to consider. This research presents a novel approach for automatic and semiautomatic shoe patina growing in the footwear industry using a new co-creative method based on cooperative robotics. The system automates the process in pursuit of operator time-saving without reducing the work finishing quality. For this purpose, the use of a collaborative robot with a built-in constant contact force control and a collaborative tool are used in this research. The use of both tools in complementarity with the knowledge of the craftsman leads the robot end-effector adaptation to the inherent curved surfaces over the shoe. Besides, some orientation corrections are applied based on the CAD model for the task to be accurately accomplished. The solution has been successfully integrated in a real production line, and it is currently in use., The authors want to thank Bespoke Factory Group (bespokefactory.com) for funding this project, CFZ Cobots (cfzcobots. com) for their technical support on robotics and mechanical design, and DESINOPE (desinope.com) for their technical support on process design related with the shoe industry. Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by Bespoke Factory Group bespokefactory.com.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Bimanual robot control for surface treatment tasks

  • García-Fernández, Alberto
  • Girbés-Juan, Vicent
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This work develops a method to perform surface treatment tasks using a bimanual robotic system, i.e. two robot arms cooperatively performing the task. In particular, one robot arm holds the work-piece while the other robot arm has the treatment tool attached to its end-effector. Moreover, the human user teleoperates all the six coordinates of the former robot arm and two coordinates of the latter robot arm, i.e. the teleoperator can move the treatment tool on the plane given by the work- piece surface. Furthermore, a force sensor attached to the treatment tool is used to automatically attain the desired pressure between the tool and the workpiece and to automatically keep the tool orientation orthogonal to the workpiece surface. In addition, to assist the human user during the teleoperation, several constraints are defined for both robot arms in order to avoid exceeding the allowed workspace, e.g. to avoid collisions with other objects in the environment. The theory used in this work to develop the bimanual robot control relies on sliding mode control and task prioritisation. Finally, the feasibility and effectiveness of the method are shown through experimental results using two robot arms., This work was supported by Generalitat Valenciana [grant numbers ACIF/2019/007 and GV/2021/181] and Spanish Ministry of Science and Innovation [grant number PID2020117421RB-C21].
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Development of a collaborative robotic system to polish leather surfaces

  • González, Alejandra
  • Perez-Vidal, Carlos
  • Borrell, Jorge
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] Patina is the natural aging process that gives leather a unique, worn appearance. However, this patina effect can also be created artificially by using specific products to rub the leather surface. This research presents a new and innovative method to automate the process of creating patina on leather footwear using collaborative robots. These types of finishing tasks on medium size objects are delicate and often require adjustments by skilled craftsmen, adding complexity to the automation process. This new solution involves designing and implementing a collaborative tool specifically created to cultivate a patina finish on shoe surfaces. The system aims to speed up the process without compromising the quality of the finished product. In order to accomplish this task, a collaborative robot that can regulate contact force and a preexisting software feature for recording manual paths are utilized together with the skills of an expert craftsman. This enables the robot¿s end effector to conform to the curved contours of the shoe. Furthermore, the tool¿s path and position are modified based on the data from the CAD model to ensure precise outcomes. This study introduces a novel technique for automated and partially automated patina development in the shoe industry. This work presents a system integrated into a productive facility and it is currently being used., This research has been partly funded by project CPP2021-008593, funded by CIN/AEI/10.13039/501100011033 and by the European Union-NextGenerationEU/PRTR. This research has been partly funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033)
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Robotic assistance for industrial sanding with a smooth approach to the surface and boundary constraints

  • García-Fernández, Alberto
  • Girbés-Juan, Vicent
  • Perez-Vidal, Carlos
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] Surface treatment operations, such as sanding, deburring, finishing, grinding, polishing, etc. are progressively becoming more automated using robotic systems. However, previous research in this field used a completely automatic operation of the robot system or considered a low degree of human-robot interaction. Therefore, to overcome this issue, this work develops a truly synergistic cooperation between the human operator and the robot system to get the best from both. In particular, in the application developed in this work the human operator provides flexibility, guiding the tool of the robot system to treat arbitrary regions of the workpiece surface; while the robot system provides strength, accuracy and security, not only holding the tool and keeping the right tool orientation, but also guaranteeing a smooth approach to the workpiece and confining the tool within the allowed area close to the workpiece. Moreover, to add more flexibility to the proposed method, when the user is not guiding the robot tool, a robot automatic operation is activated to perform the treatment in prior established regions. Furthermore, a camera network is used to get a global view of the robot workspace in order to obtain the workpiece location accurately and in real-time. The effectiveness of the proposed approach is shown with several experiments using a 6R robotic arm., This research was founded by the Spanish Government and the Generalitat Valenciana under Grants PID2020-117421RB-C21, GV/2021/181 and ACIF/2019/007.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Application of Neural Radiance Fields (NeRFs) for 3D Model Representation in the Industrial Metaverse

  • Fabra, Lidia
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Alabau, Alba|||0000-0002-7570-6855
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] This study explores the utilization of Neural Radiance Fields (NeRFs), with a specific focus on the Instant NeRFs technique. The objective is to represent three-dimensional (3D) models within the context of the industrial metaverse, aiming to achieve a high-fidelity reconstruction of objects in virtual environments. NeRFs, renowned for their innovative approach, enable comprehensive model reconstructions by integrating diverse viewpoints and lighting conditions. The study employs tools such as Unity, Photon Pun2, and Oculus Interaction SDK to develop an immersive metaverse. Within this virtual industrial environment, users encounter numerous interactive six-dimensional (6D) models, fostering active engagement and enriching the overall experience. While initial implementations showcase promising results, they also introduce computational complexities. Nevertheless, this integration forms the basis for immersive comprehension and collaborative interactions within the industrial metaverse. The evolving potential of NeRF technology promises even more exciting prospects in the future., This work has been funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Exploring the Relationship between the Coverage of AI in WIRED Magazine and Public Opinion Using Sentiment Analysis

  • Moriniello, Flavio
  • Silva Jasaui, Daniel
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
[EN] The presence and significance of artificial intelligence (AI) technology in society have been steadily increasing since 2000. While its potential benefits are widely acknowledged, concerns about its impact on society, the economy, and ethics have also been raised. Consequently, artificial intelligence has garnered widespread attention in news media and popular culture. As mass media plays a pivotal role in shaping public perception, it is crucial to evaluate opinions expressed in these outlets. Understanding the public¿s perception of artificial intelligence is essential for effective public policy and decision making. This paper presents the results of a sentiment analysis study conducted on WIRED magazine¿s coverage of artificial intelligence between January 2018 and April 2023. The objective of the study is to assess the prevailing opinions towards artificial intelligence in articles from WIRED magazine, which is widely recognized as one of the most reputable and influential publications in the field of technology and innovation. Using two sentiment analysis techniques, AFINN and VADER, a total of 4265 articles were analyzed for positive, negative, and neutral sentiments. Additionally, a term frequency analysis was conducted to categorize articles based on the frequency of mentions of artificial intelligence. Finally, a linear regression analysis of the mean positive and negative sentiments was performed to examine trends for each month over a five-year period. The results revealed a leading pattern: there was a predominant positive sentiment with an upward trend in both positive and negative sentiments. This polarization of sentiment suggests a shift towards more extreme positions, which should influence public policy and decision making in the near future., This work has been funded by the Spanish Government (Grant PID2020-117421RBC21 funded by MCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant INVEST/2022/324).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

A Methodology to Produce Augmented-Reality Guided Tours in Museums for Mixed-Reality Headsets

  • Martí Testón, Ana|||0000-0002-5058-2868
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] In recent years, the use of technology in the museum context has changed radically. It has switched from the display of information to offering emotive, immersive, and rich experiences with heritage. Virtual interactive media have the potential to put museums back into a relevant place in our increasingly digital society. The emergence of augmented-reality glasses offers the possibility to test and implement new methodologies compatible with this aim. However, most of the first examples developed in recent years did not take advantage of the possibilities of this new medium. This paper presents a novel methodology for producing mixed-reality applications for museums and heritage sites, with an intuitive, immersive, and natural way of operating. An experimental prototype designed for the archaeological museum of the Almoina is shown in the paper to demonstrate the benefits of the proposed system and methodology of production. In addition, the paper shows the results of several tests., This research was founded by the Generalitat Valenciana (Grant GV/2021/181) and by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Using WebXR Metaverse Platforms to Create Touristic Services and Cultural Promotion

  • Martí Testón, Ana|||0000-0002-5058-2868
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Solanes, J. Ernesto|||0000-0001-5011-4872
[EN] In recent years, there has been a surge of Metaverse applications and tools striving to capture the attention of both the general public and businesses, with a particularly strong potential within the tourism sector. However, there has been significant criticism towards major corporations for marketing a concept of the Metaverse that fails to align with reality. On the other hand, smaller entities such as Spatial-io, which is an innovative metaverse platform, are introducing a different style of the Metaverse, one that is highly accessible from contemporary devices like smartphones, tablets, VR headsets, and traditional PCs via WebXR platforms. This article delves into and scrutinizes various methodologies of a tourism-oriented Metaverse, considering its prospective utility as a vehicle to attract more visitors. A virtual tourist information center was established on the Spatial-io Metaverse platform to promote Valencia, Spain. This research scrutinizes the navigation, accessibility, and usability of the service from a conventional PC browser, contrasting it with the experience offered by the Meta Quest 2 virtual reality headset. The study¿s quantitative and qualitative data analysis indicates that these innovative services are highly regarded, particularly when a real person (not a bot) provides information, fostering trust and offering details about various tourist attractions within the promoted city. The comparison of user inquiries¿ time and depth aligns with the immersion level, demonstrating more positive feedback when the service is accessed through the VR system rather than a standard PC browser., This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Generalization of reference filtering control strategy for 2D/3D visual feedback control of industrial robot manipulators

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz-Benavent, Pau|||0000-0003-4681-183X
  • Leopoldo Armesto|||0000-0003-0979-4428
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This paper develops the application of the Dual Rate Dual Sampling Reference Filtering Control Strategy to 2D and 3D visual feedback control. This strategy allows to overcome the problem of sensor latency and to address the problem of control task failure due to visual features leaving the camera field of view. In particular, a Dual Rate Kalman Filter is used to generate inter-sample estimations of the visual features to deal with the problem of vision sensor latency, whereas a Dual Rate Extended Kalman Filter Smoother is used to generate more convenient visual features trajectories in the image plane. Both 2D and 3D visual feedback control approaches are widely analyzed throughout the paper, as well as the overall system performance using different visual feedback controllers, providing a set of results that highlight the improvements in terms of solution reachability, robustness, and time domain response. The proposed control strategy has been validated on an industrial system with hard real-time limitations, consisting of a 6 DOF industrial manipulator, a 5 MP camera, and a PLC as controller., This work was supported in part by the Spanish Government under the projects PID2020-117421RB-C21 and PID2020116585GB-I00, and in part by the Generalitat Valenciana under the project GV/2021/181.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] This work proposes a new interface for the teleoperation of mobile robots based on virtual reality that allows a natural and intuitive interaction and cooperation between the human and the robot, which is useful for many situations, such as inspection tasks, the mapping of complex environments, etc. Contrary to previous works, the proposed interface does not seek the realism of the virtual environment but provides all the minimum necessary elements that allow the user to carry out the teleoperation task in a more natural and intuitive way. The teleoperation is carried out in such a way that the human user and the mobile robot cooperate in a synergistic way to properly accomplish the task: the user guides the robot through the environment in order to benefit from the intelligence and adaptability of the human, whereas the robot is able to automatically avoid collisions with the objects in the environment in order to benefit from its fast response. The latter is carried out using the well-known potential field-based navigation method. The efficacy of the proposed method is demonstrated through experimentation with the Turtlebot3 Burger mobile robot in both simulation and real-world scenarios. In addition, usability and presence questionnaires were also conducted with users of different ages and backgrounds to demonstrate the benefits of the proposed approach. In particular, the results of these questionnaires show that the proposed virtual reality based interface is intuitive, ergonomic and easy to use., This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded byMCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant GV/2021/181).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Virtual Production: Real-Time Rendering Pipelines for Indie Studios and the Potential in Different Scenarios

  • Silva Jasaui, Daniel
  • Moriniello, Flavio
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] This work aims to identify and propose a functional pipeline for indie live-action films using Virtual Production with photorealistic real-time rendering game engines. The new production landscape is radically changing how movies and shows are made. Those were made in a linear pipeline, and now filmmakers can execute multiple tasks in a parallel mode using real-time renderers with high potential for different types of productions. Four interviews of professionals in the Spanish film and television market were conducted to obtain the whole perspective of the new paradigm. Following those examples, a virtual production set was implemented with an Antilatency tracking system, Unreal Engine (version 5.3), and Aximmetry (version 2023.3.2) as the leading software applications. Results are commented on, presenting how all the work is currently closely connected between pre-production, shooting, and post-production and analyzing its potential in different fields., Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033) and Generalitat Valenciana (Grant INVEST/2022/324).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Enriching User-Visitor Experiences in Digital Museology: Combining Social and Virtual Interaction within a Metaverse Environment

  • Alabau, Alba|||0000-0002-7570-6855
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Fabra, Lidia
[EN] This study investigates the potential of integrating multilayer animations and sophisticated shader technologies to enhance visitor social interactions within metaverse exhibition spaces. It is part of a broader initiative aimed at developing innovative digital museology strategies that foster social engagement through virtual reality (VR) experiences. The methodology adopted seeks to provide a more immersive and human-centric exploration of 3D digital environments by blending elements of physical spaces with the interactive dynamics common in video games. A virtual exhibition space themed around Mars was created as a testbed to facilitate social interactions among users, who navigate the environment via avatars. This digital space was developed using a specialized Unity template designed by the metaverse platform Spatial.io. Overcoming the programming constraints imposed by Spatial.io, which limits the use of external scripts for security and stability, posed a significant challenge. Nonetheless, by leveraging the ability to modify shader codes used for material creation and employing advanced animation techniques with layered effects, the authors of this work achieved dynamic material responses to lighting changes and initiated complex asset interactions beyond simple linear animations., This work has been funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant INVEST/2022/324).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Augmented Reality-Based Interface for Bimanual Robot Teleoperation

  • García-Fernández, Alberto
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Tornero Montserrat, Josep|||0000-0003-1571-0251
[EN] Teleoperation of bimanual robots is being used to carry out complex tasks such as surgeries in medicine. Despite the technological advances, current interfaces are not natural to the users, who spend long periods of time in learning how to use these interfaces. In order to mitigate this issue, this work proposes a novel augmented reality-based interface for teleoperating bimanual robots. The proposed interface is more natural to the user and reduces the interface learning process. A full description of the proposed interface is detailed in the paper, whereas its effectiveness is shown experimentally using two industrial robot manipulators. Moreover, the drawbacks and limitations of the classic teleoperation interface using joysticks are analyzed in order to highlight the benefits of the proposed augmented reality-based interface approach., This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grants GV/2021/ 181 and ACIF/2019/007).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Enhancing STEM Education through Interactive Metaverses: A Case Study and Methodological Framework

  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Montava-Jorda, Sergi|||0000-0002-5378-0333
  • Golf Laville, Emilio Jesus|||0000-0002-4827-9560
  • Colomer-Romero, Vicente|||0000-0001-7458-7658
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
  • Muñoz García, Adolfo|||0000-0003-2435-3348
[EN] In recent years, the rapid growth of virtual reality has opened up new possibilities for creating immersive virtual worlds known as metaverses. With advancements in technology, such as virtual reality headsets, and the emergence of applications with social interaction, metaverses offer exciting opportunities for STEM (Science, Technology, Engineering, and Mathematics) education. This article proposes the integration of metaverses into STEM courses, enabling students to forge connections between different subjects within their curriculum, to leverage current technological advancements, and to revolutionize project presentations and audience interaction. Drawing upon a case study conducted with students enrolled in the ¿Proyectos RII 1: Organización y Escenarios¿ course at the Escuela Politécnica Superior de Alcoy of the Technical University of Valencia (Spain), this article provides a comprehensive description of the methodology employed by the students and professors. It outlines the process followed, shedding light on the innovative use of metaverses in their projects. Moreover, the article shares valuable insights obtained through surveys and personal opinions gathered from students throughout the course and upon its completion. By exploring the intersection of metaverses and STEM education, this study showcases the transformative potential of integrating interactive virtual environments. Furthermore, this work highlights the benefits of increased student engagement, motivation, and collaboration, as well as the novel ways in which projects can be presented and interactions with audiences can be redefined., This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033)
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Enhancing Cultural Heritage Engagement with Novel Interactive Extended-Reality Multisensory System

  • Muñoz García, Adolfo|||0000-0003-2435-3348
  • Climent-Ferrer, Juan José|||0000-0003-4130-6439
  • Martí Testón, Ana|||0000-0002-5058-2868
  • Solanes, J. Ernesto|||0000-0001-5011-4872
  • Gracia Calandin, Luis Ignacio|||0000-0001-9258-9286
[EN] Extended-reality (XR) tools are increasingly used to revitalise museum experiences, but typical head-mounted or smartphone solutions tend to fragment audiences and suppress the social dialogue that makes cultural heritage memorable. This article addresses that gap on two fronts. First, it proposes a four-phase design methodology¿spanning artifact selection, narrative framing, tangible-interface fabrication, spatial installation, software integration, validation, and deployment¿that helps curators, designers, and technologists to co-create XR exhibitions in which co-presence, embodied action, and multisensory cues are treated as primary design goals rather than afterthoughts. Second, the paper reports LanternXR, a proof-of-concept built with the methodology: visitors share a 3D-printed replica of the fourteenth-century Virgin of Boixadors while wielding a tracked ¿camera¿ and a candle-like lantern that lets them illuminate, photograph, and annotate the sculpture inside a life-sized Gothic nave rendered on large 4K displays with spatial audio and responsive lighting. To validate the approach, the article presents an analytical synthesis of feedback from curators, museologists, and XR technologists, underscoring the system¿s capacity to foster collaboration, deepen engagement, and broaden accessibility. The findings show how XR can move museum audiences from isolated immersion to collective, multisensory exploration., This work has been funded by the Spanish Government (Grants PID2024-156583OB-I00 and PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Enriching user-visitor experiences in digital museology: Combining social and virtual interaction within a metaverse environment

  • Alabau, Alba
  • Fabra-Cuenca, Lidia
  • Martí-Testón, Ana
  • Muñoz, Adolfo
  • Solanes, J. Ernesto
  • Gracia, Luis
This article belongs to the Special Issue Virtual Reality Technology: Current Applications, Challenges and Its Future., This study investigates the potential of integrating multilayer animations and sophisticated shader technologies to enhance visitor social interactions within metaverse exhibition spaces. It is part of a broader initiative aimed at developing innovative digital museology strategies that foster social engagement through virtual reality (VR) experiences. The methodology adopted seeks to provide a more immersive and human-centric exploration of 3D digital environments by blending elements of physical spaces with the interactive dynamics common in video games. A virtual exhibition space themed around Mars was created as a testbed to facilitate social interactions among users, who navigate the environment via avatars. This digital space was developed using a specialized Unity template designed by the metaverse platform Spatial.io. Overcoming the programming constraints imposed by Spatial.io, which limits the use of external scripts for security and stability, posed a significant challenge. Nonetheless, by leveraging the ability to modify shader codes used for material creation and employing advanced animation techniques with layered effects, the authors of this work achieved dynamic material responses to lighting changes and initiated complex asset interactions beyond simple linear animations., This work has been funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant INVEST/2022/324)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Application of neural radiance fields (NeRFs) for 3D model representation in the industrial metaverse

  • Fabra-Cuenca, Lidia
  • Solanes, J. Ernesto
  • Muñoz, Adolfo
  • Martí-Testón, Ana
  • Alabau, Alba
  • Gracia, Luis
This article belongs to the Special Issue Extended Reality Applications in Industrial Systems., This study explores the utilization of Neural Radiance Fields (NeRFs), with a specific focus on the Instant NeRFs technique. The objective is to represent three-dimensional (3D) models within the context of the industrial metaverse, aiming to achieve a high-fidelity reconstruction of objects in virtual environments. NeRFs, renowned for their innovative approach, enable comprehensive model reconstructions by integrating diverse viewpoints and lighting conditions. The study employs tools such as Unity, Photon Pun2, and Oculus Interaction SDK to develop an immersive metaverse. Within this virtual industrial environment, users encounter numerous interactive six-dimensional (6D) models, fostering active engagement and enriching the overall experience. While initial implementations showcase promising results, they also introduce computational complexities. Nevertheless, this integration forms the basis for immersive comprehension and collaborative interactions within the industrial metaverse. The evolving potential of NeRF technology promises even more exciting prospects in the future., This work has been funded by the Spanish Government (Grant PID2020-117421RB-C21 funded by MCIN/AEI/10.13039/501100011033)., Peer reviewed