Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 29
Encontrada(s) 1 página(s)

Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Otros (Other)

El sueño de tocar gráficos 3D en el aire

  • Marzo Pérez, Asier
Estamos acostumbrados a ver hologramas con personas, animales y objetos que parecen reales pero que en realidad no existen y no podemos tocar. Arrastrar un icono en un móvil o una tableta es nuestro pan de cada día, pero son elementos planos, no están en tres dimensiones. En este punto nuestro proyecto InteVol surge y marca su meta: crear gráficos 3D en el aire y poder interactuar con ellos. Tocarlos, modificarlos, manipularlos. Al más puro estilo de películas como Iron Man. El reto es crear el primer display volumétrico con interacción directa que permita a las personas introducir sus manos u otros objetos dentro del dispositivo para agarrar y manipular los gráficos directamente. Para ello, contamos con el apoyo de una beca del European Research Council (ERC) que busca proyectos de alto riesgo, pero rompedores. Es decir, tecnologías categóricamente nuevas., Asier Marzo Pérez recibe fondos de la unión europea a través del proyecto FET TOUCHLESS y del ERC StG InteVol., Asier Marzo Pérez recibe fondos de la unión europea a través del proyecto FET TOUCHLESS y del ERC StG InteVol
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Contactless electrostatic piloerection for haptic sensations

  • Iriarte Cárdenas, Naroa
  • Ezcurdia Aguirre, Íñigo Fermín
  • Elizondo Martínez, Sonia
  • Irisarri Erviti, Josu
  • Hemmerling, Daria
  • Ortiz Nicolás, Amalia
  • Marzo Pérez, Asier
In this project, we create artificial piloerection using contactless electrostatics to induce tactile sensations in a contactless way. Firstly, we design various high-voltage generators and evaluate them in terms of their static charge, safety and frequency response with different electrodes as well as grounding strategies. Secondly, a psychophysics user study revealed which parts of the upper body are more sensitive to electrostatic piloerection and what adjectives are associated with them. Finally, we combine an electrostatic generator to produce artificial piloerection on the nape with a head-mounted display, this device provides an augmented virtual experience related to fear. We hope that work encourages designers to explore contactless piloerection for enhancing experiences such as music, short movies, video games, or exhibitions., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

PointerVol: a laser pointer for swept volumetric displays

  • Fernández Ortega, Unai Javier
  • Sarasate Azcona, Iosune
  • Ezcurdia Aguirre, Íñigo Fermín
  • López-Amo Ocón, Manuel
  • Fernández Fernández, Iván
  • Marzo Pérez, Asier
A laser pointer is a commonly used device that does not require communication with the display system or modifications on the applications, the presenter can just take a pointer and start using it. When a laser pointer is used on a volumetric display, a line rather than a point appears, making it not suitable for pointing at 3D locations. PointerVol is a modified laser pointer that allows users to point to 3D positions inside a swept volumetric display. We propose two PointerVol implementations based on timing and distance measurements, we evaluate the pointing performance using them. Finally, we present other features such as multi-user pointing, line patterns and a multi-finger wearable. PointerVol is a simple device that can help to popularize volumetric displays, or at least to make them more usable for presentations with true-3D content., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, and by the European Research Consortium under grant agreement No 101042702 Intevol-ERC2021-STG
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

LeviPrint: contactless additive manufacturing using acoustic levitation with position and orientation control of elongated parts

  • Ezcurdia Aguirre, Íñigo Fermín
  • Morales González, Rafael
  • Marzo Pérez, Asier
LeviPrint assembles small objects in a contactless way using ultrasonic phased-arrays and optimization algorithms. We explore a set of methods that enables 6 Degrees-of-Freedom (DoF) control of elongated bodies. We then evaluate different ultrasonic arrangements to optimize the manipulation of these bodies. The combination of arrangements and optimization algorithms allow us to levitate, orientate and assemble complex objects. These techniques and arrangements can be leveraged for the microfabrication of electromechanical components and in-vivo additive manufacturing. We highlight the reduction of cross-contamination and the capability to manufacture inside closed containers from the outside., This research was funded by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101017746, TOUCHLESS
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Design of an immersive virtual reality framework to enhance the sense of agency using affective computing technologies

  • Ortiz Nicolás, Amalia
  • Elizondo Martínez, Sonia
Virtual Reality is expanding its use to several fields of application, including health and education. The continuous growth of this technology comes with new challenges related to the ways in which users feel inside these virtual environments. There are various guidelines on ways to enhance users’ virtual experience in terms of immersion or presence. Nonetheless, there is no extensive research on enhancing the sense of agency (SoA), a phenomenon which refers to the self-awareness of initiating, executing, and controlling one’s actions in the world. After reviewing the state of the art of technologies developed in the field of Affective Computing (AC), we propose a framework for designing immersive virtual environments (IVE) to enhance the users’ SoA. The framework defines the flow of interaction between users and the virtual world, as well as the AC technologies required for each interactive component to recognise, interpret and respond coherently within the IVE in order to enhance the SoA., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No. 101017746.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Using low-frequency sound to create non-contact sensations on and In the body

  • Hassan, Waseem
  • Marzo Pérez, Asier
  • Hornbæk, Kasper
This paper proposes a method for generating non-contact sensations using low-frequency sound waves without requiring user instrumentation. This method leverages the fundamental acoustic response of a confined space to produce predictable pressure spatial distributions at low frequencies, called modes. These modes can be used to produce sensations either throughout the body, in localized areas of the body, or within the body. We first validate the location and strength of the modes simulated by acoustic modeling. Next, a perceptual study is conducted to show how different frequencies produce qualitatively different sensations across and within the participants' bodies. The low-frequency sound offers a new way of delivering non-contact sensations throughout the body. The results indicate a high accuracy for predicting sensations at specific body locations., This work is funded by the European Union's Horizon 2020 research and innovation programme [grant number 101017746, TOUCH-LESS].
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Complex selective manipulations of thermomagnetic programmable matter

  • Irisarri Erviti, Josu
  • Ezcurdia Aguirre, Íñigo Fermín
  • Sandúa Fernández, Xabier
  • Galarreta Rodríguez, Itziar
  • Pérez de Landazábal Berganzo, José Ignacio
  • Marzo Pérez, Asier
Programmable matter can change its shape, stiffness or other physical properties upon command. Previous work has shown contactless optically controlled matter or magnetic actuation, but the former is limited in strength and the latter in spatial resolution. Here, we show an unprecedented level of control combining light patterns and magnetic fields. A mixture of thermoplastic and ferromagnetic powder is heated up at specific locations that become malleable and are attracted by magnetic fields. These heated areas solidify on cool down, and the process can be repeated. We show complex control of 3D slabs, 2D sheets, and 1D filaments with applications in tactile displays and object manipulation. Due to the low transition temperature and the possibility of using microwave heating, the compound can be manipulated in air, water, or inside biological tissue having the potential to revolutionize biomedical devices, robotics or display technologies., This research is funded by the EU Horizon 2020 research and innovation programme under grant agreement No. 101017746 TOUCHLESS
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Hand-as-a-prop: using the hand as a haptic proxy for manipulation in virtual reality

  • Marichalar Baraibar, Sebastian Roberto
  • Ezcurdia Aguirre, Íñigo Fermín
  • Morales González, Rafael
  • Ortiz Nicolás, Amalia
  • Marzo Pérez, Asier
  • Ardaiz Villanueva, Óscar
Haptic feedback can be almost as important as visual information in virtual reality environments. On the one hand, in Active Haptic Feedback, specialized devices such as vibrotactile gloves are employed; however, these solutions can be expensive, vendor-specific or cumbersome to setup. On the other hand, Passive Haptic Feedback approaches use inexpensive objects as proxies for the virtual entities; but mapping virtual objects to real props is not scalable nor flexible. We propose the Hand-as-a-Prop technique, which consists in using human hands as object props. We implemented two modalities: Self, where the user¿s non-dominant hand act as the virtual object while the dominant hand grabs, translates and releases it; and External, where the hand of another person is used. Hand-as-a-Prop can represent multiple shapes with a single prop and does not require extra hardware. We performed an evaluation comparing both Self and External Hand-as-a-Prop with traditional Object Props in terms of user experience (goodness, ease, realism, fatigue, and preference) and performance (task completion time and translation time). Results showed that Hand-as-a-Prop was rated as neutral tending to positive, and in some cases, the performance was similar to Object Props. Users preferred Self Hand-as-a-Prop over External Hand-as-a-Prop and also obtained better results., Open Access funding provided by Universidad Pública de Navarra. Sebastian Marichalar was funded by Public University of Navarra postdoc contract OTRI-2020–901-135. This research was partially funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

SparkTouch: contactless haptic spatial patterns on the palm and fingertip using electric sparks

  • Donkov Bogdanov, Stefan
  • Bouzbib, Elodie Lyath
  • Aldea Esnaola, Mikel
  • Irisarri Erviti, Josu
  • Elizondo Martínez, Sonia
  • Ezcurdia Aguirre, Íñigo Fermín
  • Marzo Pérez, Asier
Contactless haptic technologies deliver tactile feedback remotely, eliminating the need for direct skin contact and reducing setup time. However, current technologies have relatively weak intensity or coarse perception resolution. This paper proposes SparkTouch, an approach exploring the use of electric arcs for delivering contactless spatio-temporal patterns in the palm and fingertip. We first quantified the perceptibility of electric sparks as a function of frequency and hand location. We then conducted a spatio-temporal pattern recognition study (n = 30), where we measured user's discrimination accuracy for sparks moving along the palm and fingertip for 14 patterns, including lines and shapes of different directions. Results show that (1) accuracy is similar to other contactless methods, (2) discrimination between lines or shapes is over 85 %, and (3) their direction can be detected. This study is the first to investigate contactless spatio-temporal haptic patterns on the fingertip; and we demonstrate (4) an equivalent recognition accuracy between fingertip and palm, making electric arcs a promising technology for mid-air haptics on the fingertip. Altogether, SparkTouch paves the way for future fine contactless haptics, with envisioned scenarios such as contactless mid-air interaction with public kiosks or keypads., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, and by the European Research Consortium under grant agreement No 101042702 Intevol- ERC2021-STG.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Heartbeat resonance: inducing non-contact heartbeat sensations in the chest

  • Hassan, Waseem
  • Da, Liyue
  • Elizondo Martínez, Sonia
  • Hornbæk, Kasper
Perceiving and altering the sensation of internal physiological states, such as heartbeats, is key for biofeedback and interoception. Yet, wearable devices used for this purpose can feel intrusive and typically fail to deliver stimuli aligned with the heart's location in the chest. To address this, we introduce Heartbeat Resonance, which uses low-frequency sound waves to create non-contact haptic sensations in the chest cavity, mimicking heartbeats. We conduct two experiments to evaluate the system's effectiveness. The first experiment shows that the system created realistic heartbeat sensations in the chest, with 78.05 Hz being the most effective frequency. In the second experiment, we evaluate the effects of entrainment by simulating faster and slower heart rates. Participants perceived the intended changes and reported high confidence in their perceptions for +15% and -30% heart rates. This system offers a non-intrusive solution for biofeedback while creating new possibilities for immersive VR environments., This work is funded by the European Union's Horizon 2020 research and innovation programme [grant number 101017746, TOUCHLESS].
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

A multi-object grasp technique for placement of objects in virtual reality

  • Fernández Ortega, Unai Javier
  • Marzo Pérez, Asier
  • Elizondo Martínez, Sonia
  • Iriarte Cárdenas, Naroa
  • Morales, Rafael
  • Ortiz Nicolás, Amalia
  • Marichalar Baraibar, Sebastian Roberto
  • Ardaiz Villanueva, Óscar
Some daily tasks involve grasping multiple objects in one hand and releasing them in a determined order, for example laying out a surgical table or distributing items on shelves. For training these tasks in Virtual Reality (VR), there is no technique for allowing users to grasp multiple objects in one hand in a realistic way, and it is not known if such a technique would benefit user experience. Here, we design a multi-object grasp technique that enables users to grasp multiple objects in one hand and release them in a controlled way. We tested an object placement task under three conditions: real life, VR with single-object grasp and VR with multi-object grasp. Task completion time, distance travelled by the hands and subjective experience were measured in three scenarios: sitting in front of a desktop table, standing up in front of shelves and a room-size scenario where walking was required. Results show that the performance in a real environment is better than in Virtual Reality, both for single-object and multi-object grasping. The single-object technique performs better than the multi-object, except for the room scenario, where multi-object leads to less distance travelled and reported physical demand. For use cases where the distances are small (i.e., desktop scenario), single-object grasp is simpler and easier to understand. For larger scenarios, the multi-object grasp technique represents a good option that can be considered by other application designers., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746; U.J.F. was funded by UPNA-Beca colaboración.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

TipTrap: a co-located direct manipulation technique for acoustically levitated content

  • Jankauskis, Eimontas
  • Elizondo Martínez, Sonia
  • Montano Murillo, Roberto
  • Marzo Pérez, Asier
  • Martinez Plasencia, Diego
Acoustic levitation has emerged as a promising approach for mid-air displays, by using multiple levitated particles as 3D voxels, cloth and thread props, or high-speed tracer particles, under the promise of creating 3D displays that users can see, hear and feel with their bare eyes, ears and hands. However, interaction with this mid-air content always occurred at a distance, since external objects in the display volume (e.g. user’s hands) can disturb the acoustic fields and make the particles fall. This paper proposes TipTrap, a co-located direct manipulation technique for acoustically levitated particles. TipTrap leverages the reflection of ultrasound on the users’ skin and employs a closed-loop system to create functional acoustic traps 2.1 mm below the fingertips, and addresses its 3 basic stages: selection, manipulation and deselection. We use Finite-Differences Time Domain (FDTD) simulations to explain the principles enabling TipTrap, and explore how finger reflections and user strategies influence the quality of the traps (e.g. approaching direction, orientation and tracking errors), and use these results to design our technique. We then implement the technique, characterizing its performance with a robotic hand setup and finish with an exploration of the ability of TipTrap to manipulate different types of levitated content., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, the AHRC UK-China Research-Industry Creative Partnerships (AH/T01136X/2) and EPSRC and Ultraleap Prosperity Fund (EP/V037846/1).
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Comparing a mid-air two-hand pinching point-and-click technique with mouse, keyboard and touchfree

  • Lafuente Duque, Melchor
  • Elizondo Martínez, Sonia
  • Fernández Ortega, Unai Javier
  • Marzo Pérez, Asier
Some of our daily activities are performed by interacting with public touchscreens, such as food kiosks, bank tellers and newsstands. Nonetheless, the physical contact with these screens that are used by different people may be considered unhygienic. To avoid contact, some screens already integrate one-hand contactless interaction technologies, i.e. Leap Motion Controller, though they may lead to arm fatigue and slow performance. We present LeapPointer, a mid-Air two-hand pinching point-And-click technique. Specifically, this technique relies on a Leap Motion device to track both hands, and proposes a new software tool that allows bimanual selection through pointing and pinching gestures. A user study was performed to compare LeapPointer with two other techniques: The common mouse/keyboard and the current UltraLeap's TouchFree technique. Task completion time and accuracy as well as subjective data were gathered. The analysis of these data suggested that LeapPointer is significantly faster than the other touchless technique although less accurate. Self-reported fatigue was less with LeapPointer than with TouchFree., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, and by the European Research Consortium under grant agreement No 101042702 Intevol-ERC2021-STG.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Smarterial – Smart matter optomagnetic

  • Irisarri Erviti, Josu
  • Marzo Pérez, Asier
  • Galarreta Rodríguez, Itziar
Smart materials, also known as programmable materials, are a combination of different components that have the capability to change shape, move around and adapt to numerous situations by applying an external controllable field. Previous works have used optically guided matter or magnetically actuated materials, but similarly to soft robots, they are limited in spatial resolution or strength. Here we propose combining a low temperature thermoplastic polymer Polycaprolactone (PCL) with ferromagnetic powder particles (Fe). Focused light can heat this compound at specific locations and make it malleable. These heated spots can be actuated by external magnetic fields. Once the material cools down, this process can be repeated, or reversed. The compound can be actuated contact-less in the form of 3D slabs, 2D sheets, and 1D filaments. We show applications for reversible tactile displays and manipulation of objects. The laboratory team has characterised the density, weight, magnetic attraction, magnetic force, phase change, thermal and electrical conductivity and heat difusión (spread point test) for smart ferromagnetic compounds of different mixture proportions. The main advantages of this smart matter optomagnetic are the high spatial resolution of light and the strong force of magnetic attraction whilst mechanical properties of polymers are practically conserved. Due to the low temperature required and the possibility to use infrared or electromagnetic induction to heat the compound, the smart material can be used in air, water, or inside biological tissue. Eventually, Smart materials will enrich collaborative movements, such as grab and hold, and more complex ones, as reshaping and reassembling., This research was funded by the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101017746, TOUCHLESS.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Mental workload of guiding devices: directional pulling forces, vibrotactile stimuli and audio cues

  • Donkov Bogdanov, Stefan
  • Elizondo Martínez, Sonia
  • Ezcurdia Aguirre, Íñigo Fermín
  • Sarasate Azcona, Iosune
  • Marzo Pérez, Asier
Asymmetric vibrations are known to produce a pulling sensation when stimulating the human hand. This effect has been exploited as a means of guidance. We conducted a user study to compare asymmetric vibrations, simple vibration, and sound cues for guidance in terms of task completion time and mental workload. Mental workload was evaluated (N=22) using the dual-task paradigm with a Stroop test and arithmetic operations test as secondary tasks. Audio cues improved significantly the task completion time for baseline and stroop tasks compared to the other methods. No significant differences were found for the reaction time for the guiding task. The use of audio cues was evaluated as the less mentally demanding guiding method on the NASA-TLX questionnaire., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, and by the European Research Consortium under grant agreement No 101042702 Intevol-ERC2021-STG.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Generating airborne ultrasonic amplitude patterns using an open hardware phased array

  • Morales González, Rafael
  • Ezcurdia Aguirre, Íñigo Fermín
  • Irisarri Erviti, Josu
  • Andrade, Marco A.B.
  • Marzo Pérez, Asier
Holographic methods from optics can be adapted to acoustics for enabling novel applications in particle manipulation or patterning by generating dynamic custom-tailored acoustic fields. Here, we present three contributions towards making the field of acoustic holography more widespread. Firstly, we introduce an iterative algorithm that accurately calculates the amplitudes and phases of an array of ultrasound emitters in order to create a target amplitude field in mid-air. Secondly, we use the algorithm to analyse the impact of spatial, amplitude and phase emission resolution on the resulting acoustic field, thus providing engineering insights towards array design. For example, we show an onset of diminishing returns for smaller than a quarter-wavelength sized emitters and a phase and amplitude resolution of eight and four divisions per period, respectively. Lastly, we present a hardware platform for the generation of acoustic holograms. The array is integrated in a single board composed of 256 emitters operating at 40 kHz. We hope that the results and procedures described within this paper enable researchers to build their own ultrasonic arrays and explore novel applications of ultrasonic holograms., This research was funded by the Government of Navarre (FEDER) 0011-1365-2019-000086 and from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 101017746, TOUCHLESS.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Tesis doctoral (DoctoralThesis)

Enhancing user experience in immersive virtual environments: advances in multiple object selection and affective interaction, Mejora de la experiencia de usuario en entornos virtuales inmersivos: avances en selección multiobjeto e interacción afectiva

  • Elizondo Martínez, Sonia
Los Entornos Virtuales Inmersivos (EVI) se utilizan para el entretenimiento, la educación, la atención sanitaria y la colaboración remota. Los EVI permiten a los usuarios participar e interactuar con contenido digital tridimensional de manera segura, consistente y controlada. Tres aspectos relevantes para lograr interacciones adecuadas entre los usuarios y los EVI son: 1) diseñar técnicas de interacción semejantes a las acciones del mundo real; 2) integrar tanto capacidades técnicas como emocionales; y 3) realizar evaluaciones exhaustivas de la experiencia de usuario para permitir una mejora constante de las capacidades de los EVI. Esta tesis doctoral ofrece una introducción detallada a los tres aspectos mencionados anteriormente: las técnicas de interacción (con un enfoque en la selección); el campo de la Computación Afectiva y cómo puede mejorar la experiencia de usuario en los EVIs; y los métodos implícitos y explícitos para evaluar tanto necesidades técnicas como emocionales con el fin de lograr una experiencia de usuario completa. Esta tesis también destaca las actuales limitaciones en la implementación de estos aspectos en los entornos virtuales y propone una nueva técnica de selección multiobjeto para los EVIs, así como un marco de diseño para guiar el desarrollo de EVIs con capacidades emocionales., Immersive Virtual Environments (IVE) are applied in entertainment, education, healthcare and remote collaboration. IVEs permit users to engage and interact with three-dimensional digital content in a safe, consistent and controlled manner. Three relevant aspects to achieve valuable interactions between users and IVEs are: 1) designing interaction techniques that resemble real-world actions; 2) integrating both technical and emotional capabilities; and 3) conducting exhaustive evaluations of the user experience to enable constant improvement of IVEs’ capabilities. This Ph.D. dissertation provides a comprehensive introduction to the three aforementioned aspects: interaction techniques (focusing on selection); the field of Affective Computing and how it can enhance user experience in IVEs; and implicit and explicit methods to evaluate both technical and emotional necessities to achieve a complete user experience. This thesis also highlights current shortcomings in the implementation of these aspects in virtual environments and proposes a new multiple object selection technique for IVEs and a design framework to guide the development of emotionally capable IVEs., Funded by the EU Horizon 2020 research and innovation programme TOUCHLESS (101017746), Programa de Doctorado en Ciencias y Tecnologías Industriales (RD 99/2011), Industria Zientzietako eta Teknologietako Doktoretza Programa (ED 99/2011)
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Mid-air contactless haptics to augment VR experiences

  • Ezcurdia Aguirre, Íñigo Fermín
  • Fernández Ortega, Unai Javier
  • Olaz Moratinos, Xabier
  • Marzo Pérez, Asier
We present four technologies to deliver contactless haptic stimuli for enriching Virtual Reality (VR) experiences. The technologies are electrostatic piloerection, focused light-induced heat, electric plasma, and ultrasound; the user does not require to wear or touch any device. We describe the working principle behind each technology and how these technologies can provide new exciting sensations in VR experiences. Additionally, we showcase a VR demo experience gathering all four remote haptic stimuli along a circuit for the users to experiment with these new sensations., This research was funded by the EU Horizon 2020 research and innovation programme No 101017746 TOUCHLESS, by the European Research Consortium No 101042702 Intevol-ERC2021-STG, and by Gobierno de Navarra Fondo Europeo de Desarrollo Regional GymTar 0011-1365-2022-000085.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

LeviPrint: contactless fabrication using full acoustic trapping of elongated parts

  • Ezcurdia Aguirre, Íñigo Fermín
  • Morales González, Rafael
  • Andrade, Marco A.B.
  • Marzo Pérez, Asier
LeviPrint is a system for assembling objects in a contactless manner using acoustic levitation. We explore a set of optimum acoustic fields that enables full trapping in position and orientation of elongated objects such as sticks. We then evaluate the capabilities of different ultrasonic levitators to dynamically manipulate these elongated objects. The combination of novel optimization algorithms and levitators enable the manipulation of sticks, beads and droplets to fabricate complex objects. A system prototype composed of a robot arm and a levitator is tested for different fabrication processes. We highlight the reduction of cross-contamination and the capability of building on top of objects from different angles as well as inside closed spaces. We hope that this technique inspires novel fabrication techniques and that reaches fields such as microfabrication of electromechanical components or even in-vivo additive manufacturing., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

Comparison of experiment and simulation of ultrasonic mid-air haptic forces

  • Morales González, Rafael
  • Georgiou, Orestis
  • Marzo Pérez, Asier
  • Frier, William
Ultrasound mid-air haptics is an emerging technology with many applications in human-computer interactions. Despite great advances in related hardware and software, physics models that predict the resulting forces on a surface (e.g., someone's hand) are either too simple (inaccurate) or too complex (computationally expensive). In this paper, we show that simple models are not sufficient when predicting the force on an experimental setup involving two prototype devices and a precision scale. Specifically, we demonstrate that our experimental measurements cannot be accurately predicted using a linear acoustic model., This project has received funding from the EU Horizon 2020 research and innovation programme under grant agreement number 101017746.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Tesis doctoral (DoctoralThesis)

Optimization of acoustic fields: advances towards its use for matter manipulation and contactless fabrication, Optimización de campos acústicos: avances hacia su uso para la manipulación de materia y la fabricación sin contacto

  • Ezcurdia Aguirre, Íñigo Fermín
Los campos de presión acústica son capaces de modelar y levitar partículas de una amplia gama de materiales y tamaños a través del aire, el agua o el tejido biológico. Esto tiene aplicaciones en cristalografía, manipulación celular, escenarios lab-on-a-chip, farmacología, transporte sin contacto e incluso levitación de seres vivos. En general, la investigación de campos de presión acústica ha experimentado avances significativos en los últimos años. Su flexibilidad y sus posibles aplicaciones han aumentado considerablemente con el desarrollo de técnicas holográficas y el uso de optimizadores. Sin embargo, aún hay margen de mejora, ya que las limitaciones dificultan la aplicación de los campos acústicos en diversos escenarios de investigación. Por ejemplo, no existe una plataforma de hardware unificada que motive de forma flexible la investigación exploratoria en aplicaciones de holografía acústica. La mayoría de los dispositivos comerciales o de caseros carecen de la resolución o la potencia que necesitan las personas investigadoras, por lo que tienen que fabricar dispositivos más complejos y caros. Además, investigaciones anteriores se han centrado en la levitación y manipulación de pequeñas partículas y gotas; sin embargo, aún no se ha desarrollado un prototipo completo para la fabricación sin contacto; no existen artículos científicos que estudien el atrapamiento de objetos alargados tanto en posición como en orientación. Además, la microfluídica está limitada en cuanto a la manipulación tridimensional (3D), el tamaño de las gotas y la contaminación cruzada. Esta tesis ofrece una introducción exhaustiva a la optimización de los campos acústicos, repasando su importancia en aplicaciones de múltiples ámbitos de la investigación y la industria. Esta tesis también examina las limitaciones y deficiencias previamente expuestas y presentes en el actual diseño y aplicación de campos acústicos. Se proponen algoritmos novedosos para generar los campos deseados y mejorar significativamente su resolución y potencia mediante multiplexación espacial y temporal. Se presenta una plataforma de hardware abierta y asequible para facilitar la adaptación a los requisitos experimentales de los investigadores que exploran nuevas aplicaciones de los hologramas ultrasónicos. Se diseñan y evalúan trampas acústicas óptimas para manipular elementos alargados controlando su posición y orientación. Se demuestra la fabricación sin contacto utilizando trampas acústicas de piezas alargadas mediante fabricación aditiva basada en partículas levitadas, varillas y resina UV; también se ilustra la adición sobre otros objetos y la construcción dentro de contenedores. Por último, se propone un sistema, destinado a microfluídica 3D, basado en ultrasonidos focalizados a través de una malla hidrófoba. Es sistema es capaz de manejar un gran número de gotas (> 40µL), y capaz de fusionarlas/dividirlas o propulsarlas verticalmente, este sistema mejora significativamente los sistemas EWOD ya existentes generando una menor contaminación superficial. Esta tesis presenta estos logros y sus trabajos relacionados, modelos, metodologías, procedimientos y conclusiones. Espero que estos trabajos supongan un avance significativo en la investigación de los campos acústicos y puedan inspirar y facilitar futuras aplicaciones novedosas de los hologramas acústicos por parte de las personas investigadoras en diversos ámbitos del mundo académico y de la industria., Acoustic pressure fields are capable of patterning and levitating particles of a wide range of materials and sizes through air, water or biological tissue. This has applications in crystallography, cell manipulation, lab-on-a-chip scenarios, pharmacology, containerless transportation and even levitation of living things. Overall, the research domain of acoustic pressure fields has seen significant advances in recent years. Its flexibility and potential applications have been greatly increased with the development of holographic techniques and the use of optimizers. However, there is still room for improvement, as limitations hinder the application of acoustic fields in various research scenarios. For example, there is no unified hardware platform that can flexibly support exploratory research in acoustic holography applications. Most commercial or DIY devices lack the resolution or power that researchers require, so they need to fabricate more complex, cumbersome and expensive devices. Moreover, previous research has focused on the levitation and manipulation of small particles and droplets; however, a full prototype for contactless fabrication has yet to be developed since there is no existing work on trapping elongated objects in position and orientation. Furthermore, microfluidics is limited in terms of three-dimensional (3D) manipulation, droplet size and cross-contamination. This thesis provides a comprehensive introduction to the optimization of acoustic fields, reviewing its importance in applications across multiple research and industry domains. This thesis also examines the previously stated limitations and shortcomings of the design and application of acoustic fields. Novel algorithms are proposed to generate desired target fields and to significantly improve their resolution and power through spatial and temporal multiplexation. An open and affordable hardware platform is presented to facilitate customisation for experimental requirements by researchers exploring novel applications for ultrasonic holograms. Optimum acoustic traps are designed and evaluated to lock elongated elements in position and orientation. Contactless fabrication using full acoustic trapping of elongated parts is demonstrated through additive manufacturing based on levitated particles, sticks and UV resin; the addition on top of other objects and building inside containers is also illustrated. Finally, a 3D digital microfluidics system is proposed based on focused ultrasound through a hydrophobic mesh. Able to handle a large number of liquid droplets (> 40µL), and capable of merging/splitting them or vertically propelling them, this system significantly improves already existing EWOD systems generating less surface contamination. This thesis presents these achievements and their related works, models, methodologies, procedures and conclusions. I hope that these pieces of work are a significant advancement in the research of acoustic fields and may inspire and facilitate future novel applications of acoustic holograms by researchers in various domains of academia and industry., Government of Navarre (FEDER) - 0011-1365-2019-000086, Jóvenes Investigadores UPNA - PJUPNA1923, EU Horizon 2020 research and innovation programme - Nº 101017746 TOUCHLESS, Programa de Doctorado en Ciencias y Tecnologías Industriales (RD 99/2011), Industria Zientzietako eta Teknologietako Doktoretza Programa (ED 99/2011)
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

LevPet: a magnetic levitating spherical pet with affective reactions

  • Sorbet Molina, Josune
  • Elizondo Martínez, Sonia
  • Iriarte Cárdenas, Naroa
  • Ortiz Nicolás, Amalia
  • Marzo Pérez, Asier
LevPet combines affective computing and magnetic levitation to create an artificial levitating pet with affective responses and novel ways of moving to express emotions. Our interactive pet can recognise the user's emotional status using computer vision, and respond to it with a low-level empathy system based on mirroring behaviour. For example, if you approach it with a happy face, the pet will greet you and move in a nimble way. A repulsive magnetic levitator is attached to a mechanical stage controlled by a computer system. On top of it, there is the pet playground, where a house, a ping-pong ball,a xylophone and other accessories are placed. Two cameras allow to capture the user's face and the objects placed on the playground, so that the pet can interact with them. LevPet is an exploration of how to communicate internal state with only a levitating sphere; it is a platform for experimentation and an interactive demo that brings together an outer-worldly levitating metallic sphere with familiar things like emotions and a playground made of traditional items., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

PhantomFields: fast time and spatial multiplexation of acoustic fields for generation of superresolution patterns

  • Elizondo Martínez, Sonia
  • Goñi Carnicero, Jaime
  • Galar Idoate, Mikel
  • Marzo Pérez, Asier
Ultrasonic fields generated by phased arrays can be tailored to obtain a custom pattern of acoustic radiation forces. These force fields can pattern particles as well as be felt by the human hand, enabling applications for bioprinting and contactless haptic devices. The forcé fields can be switched orders of magnitude faster than the reaction time of the particles that it pushes or the human mechanoreceptors of touch. Therefore, a quick multiplexation in time or in space of different acoustic fields will be perceived as the average field. In this paper, we optimise the non-linear problem of decomposing a target force field into several multiplexed acoustic fields. We create averaged fields, PhantomFields, that cannot be created by a regular (unique) emission of an acoustic field. We improve accuracy by time multiplexation and spatial multiplexation, i.e. quick rotation of the emitters. These processes improve the resolution and strength of the obtained fields without the requirement of new hardware, opening up applications in haptic devices and 3D printing., This project has received funding from the EU Horizon 2020 research and innovation programme under grant agreement No 101017746.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

TOUCHLESS: demonstrations of contactless haptics for affective touch

  • Chew, Sean
  • Dalsgaard, Tor-Salve
  • Maunsbach, Martin
  • Bergström, Joanna
  • Seifi, Hasti
  • Hornbæk, Kasper
  • Irisarri Erviti, Josu
  • Ezcurdia Aguirre, Íñigo Fermín
  • Iriarte Cárdenas, Naroa
  • Marzo Pérez, Asier
  • Frier, William
  • Georgiou, Orestis
  • Sheremetieva, Anna
  • Kwarciak, Kamil
  • Stroiński, Maciej
  • Hemmerling, Daria
  • Maksymenko, Mykola
  • Cataldo, Antonio
  • Obrist, Marianna
  • Haggard, Patrick
  • Subramanian, Sriram
A set of demonstrators of contactless haptic principles is described in this work. The technologies are based on electrostatic piloerection, chemical compounds and ultrasound. Additionally, applications related to affective touch are presented, ranging from storytelling to biosignal transfer, accompanied with a simple application to edit dynamic tactile patterns in an easy way. The demonstrators are the result of the Touchless project, which is a H2020 european collaborative project that integrates 3 universities and 3 companies. These demostrators are contactless haptic experiences and thus facilitate the come-and-interact paradigm, where users can approach the demo booth and directly experience the applications without having to wear devices, making the experience fast and hygienic., Funded by EU Horizon 2020 research and innovation programme grant agreement No 101017746 TOUCHLESS.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Tesis doctoral (DoctoralThesis)

Novel contactless haptic technologies for creating affective tactile sensations when interacting with computer systems, Tecnologías hápticas sin contacto novedosas para crear sensaciones táctiles afectivas al interactuar con sistemas informáticos

  • Irisarri Erviti, Josu
Esta tesis doctoral desarrolla y explora nuevas tecnologías hápticas sin contacto para generar sensaciones táctiles en los usuarios a distancia y sin obligarles a llevar dispositivos. De esta forma, se reduce el tiempo de empezar a usar el sistema y se mejora la disponibilidad a utilizar dispositivos públicos. Utilizando hápticas sin contacto, esta tesis también quiere ir más allá del tacto funcional (p.ej., notificaciones o discriminación de objetos) e intenta reproducir algunas experiencias perdidas en entornos virtuales como el tacto afectivo. Por ejemplo, los movimientos de roce en el antebrazo pueden tener un fuerte significado afectivo (caricias) pero la tecnología de ultrasonidos focalizados actual no estimula con suficiente intensidad estas áreas de piel. Sin embargo, otras tecnologías sin contacto, como la luz infrarroja o la electrostática podrían generar estas sensaciones afectivas. Los sentidos visual y auditivo han dominado los sistemas de interacción humano-ordenador, a veces desatendiendo el sentido del tacto. En este trabajo, se presentan tecnologías hápticas que pueden proporcionar sensaciones táctil a distancia. Tienen el potencial de mejorar las experiencias inmersivas en entornos virtuales, así como de facilitar una conexión más profunda entre sus usuarios. Esta tesis también explora brevemente el uso de la háptica sin contacto para experiencias multimodales, tecnologías sin contacto y computación afectiva. En primer lugar, la tesis desarrolla una técnica híbrida, un material inteligente que es una combinación de termoplástico y polvo de hierro que se puede activar a distancia mediante calor y campos magnéticos, pero el usuario sigue necesitando contacto directo con el material. Se pensó que este sistema sería la base para comparaciones. En segundo lugar, se presenta una demostración utilizando electrostática para crear piloerección en el antebrazo. Esta tecnología puede actuar a distancia y tiene el potencial de crear estímulos afectivos. En tercer lugar, se combinan el plasma eléctrico y el ultrasonido para guíar chispas eléctricas en el aire, capaz de generar estímulos fuertes y con una buena resolución espacial y temporal. Finalmente, se explican combinaciones aún inacabadas de tecnologías; como ultrasonido, electrostática, chispas eléctricas, aerosoles, luz infrarroja, cambio de humedad/temperatura, aire y láseres. Espero que este trabajo sirva para introducir otras tecnologías hápticas sin contacto distintas de los ultrasonidos, que ha sido la tecnología dominante en la última década. Tener disponibles más tecnologías hápticas sin contacto, puede motivar la incorporación de feedback táctil en algunos sistemas de interacción entre humanos-computadoras, como las experiencias interactivas públicas en exposiciones, museos o teatros., This doctoral thesis develops and explores new contactless haptic technologies to generate tactile sensations on users from a distance and without forcing them to wear devices. Thus, the setup time is reduced and the reluctance towards using public devices is lowered.Moreover, using contactless haptics, this thesis aims to go beyond functional touch (e.g., notifications or object discrimination) and tries to reproduce some experiences lost on virtual environments such as affective touch. For example, stroking motions on the forearm can carry strong affective meaning (caresses) but current focused ultrasound does not stimulate with enough intensity these nonglabrous skin areas. However, other contactless technologies, such as infrared light or electrostatics could generate these affective sensations. Traditionally, visual and auditory senses have dominated human-computer interaction systems, sometimes overshadowing the sense of touch. In this work, emergent haptic technologies that can deliver tactile feedback from a distance are presented. They hold the potential to enhance immersive experiences in virtual environments, as well as facilitate a deeper connection between their users. This thesis also briefly explores the use of contactless haptics for multimodal experiences, touch-free technologies and affective computing. Firstly, the thesis develops a hybrid technique, a smart material that is a combination of thermoplastic and iron powder that can be actuated from a distance using heat and magnetic fields, yet the user still needs direct contact with the material. This systemwas thought to be the baseline for comparisons. Secondly, a demonstration using electrostatics to create piloerection on the forearm is presented. This technology can act at a distance and has the potential to create affective stimuli. Thirdly, electric plasma and ultrasound are put together to show a guidance system for electric sparks in mid-air, capable of strong stimuli as well as high spatial and temporal resolution. Finally, yet unfinished combinations of technologies are explained; such as ultrasound, electrostatics, electric sparks, aerosols, infrared light, humidity/temperature change, air blowing and lasers. I expect thiswork to introduce other technologies for contactless haptics different from ultrasound, which has been the dominant technology in the past decade. More contactless haptics can motivate the addition of tactile feedback in some human-computer interactive systems like public experiences such as exhibitions, museums or theaters., Government of Navarre (FEDER) (0011-1365-2019-000086) and EU Horizon 2020 research and innovation programme (Nº 101017746 TOUCHLESS), Programa de Doctorado en Ciencias y Tecnologías Industriales (RD 99/2011), Industria Zientzietako eta Teknologietako Doktoretza Programa (ED 99/2011)
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Electric plasma guided with ultrasonic fields

  • Irisarri Erviti, Josu
  • Ezcurdia Aguirre, Íñigo Fermín
  • Iriarte Cárdenas, Naroa
  • Sirkka, Marika
  • Nikolaev, Dmitry
  • Mäkinen, Joni
  • Martinez-Marchese, Alexander
  • Iablonskyi, Denys
  • Salmi, Ari
  • Marzo Pérez, Asier
Electric plasma forms sparks in midair that transfer electrical current. This current can power high-voltage electronics, kill bacteria, produce tactile sensations, or be used for welding. However, the formation of the spark is chaotic and hard to control. Laser pulses can guide discharges but require high power and are disruptive and cumbersome to control. Here, we show that ultrasonic fields can guide plasma sparks, even around obstacles. The ultrasonic beams can be directed dynamically and within milliseconds, enabling precise, nondangerous, and fast control of high-voltage sparks. This phenomenon can be used for applications in high-voltage switching and plasma treatments., J.I., I.E., and A.M. were funded by the EU Horizon 2020 research and innovation programme under grant agreement no. 101017746 TOUCHLESS; I.E., N.I., and A.M. by the European Research Consortium under grant agreement no. 101042702 Intevol-ERC2021-STG; and M.S., J.M., D.I., and A.S. by the NextGenerationEU instrument via the Research Council of Finland grant numbers 353441 and 353442.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

Enhancing the quality of amplitude patterns using time-multiplexed virtual acoustic fields

  • Elizondo Martínez, Sonia
  • Ezcurdia Aguirre, Íñigo Fermín
  • Goñi Carnicero, Jaime
  • Galar Idoate, Mikel
  • Marzo Pérez, Asier
Ultrasonic fields can push and levitate particles, heat up materials, induce contactless tactile stimuli, or affect the blood-brain barrier. Current phased-arrays can create dynamic amplitude patterns, but their quality may be insufficient due to the limited density of emitters. On the other hand, passive modulators can provide high quality, but only static patterns can be generated. Here, we show and evaluate how the average of multiple time-multiplexed amplitude fields improves the resolution of the obtained patterns when compared with the traditional single-emission method. We optimize the non-linear problem of decomposing a target amplitude field into multiple fields considering the limitations of the phased-array. The presented technique improves the quality for existing setups without modifying the equipment, having the potential to improve bio-printing, haptic devices, or ultrasonic medical treatments., This research was funded by the EU Horizon 2020 research and innovation programme under Grant Agreement No. 101017746 TOUCHLESS and by the European Research Consortium under Grant Agreement No. 101042702 Intevol-ERC2021-STG.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Artículo científico (JournalArticle)

ElectroCaresses: contactless apparent motion on the forearm using electrostatic piloerection

  • Bouzbib, Elodie Lyath
  • Donkov Bogdanov, Stefan
  • Elizondo Martínez, Sonia
  • Irisarri Erviti, Josu
  • Aldea Esnaola, Mikel
  • Ezcurdia Aguirre, Íñigo Fermín
  • Iriarte Cárdenas, Naroa
  • Marzo Pérez, Asier
Devices capable of stroking the user's forearm are being explored for digitally mediated touch but are mainly contact-based. We propose ElectroCaresses, the use of electrostatic piloerection to convey contactless gentle strokes by generating dynamic patterns of hair erection along the forearm. We investigated if a discrete set of electrodes can convey apparent motion (n=12), and evaluated effects of distance, duration and direction on continuity perception. We show that participants can discriminate stimuli direction with a high accuracy (93%) and perceive a continuous stroking stimulus using discrete signals. We finally propose guidelines for designing haptic illusions of motion using electrostatics-based haptics., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, and by the European Research Consortium under grant agreement No 101042702 Intevol-ERC2021-STG.
Academica-e. Repositorio Institucional de la Universidad Pública de Navarra
Publication Contribución de congreso (ConferenceOutput)

FlexiVol: a volumetric display with an elastic diffuser to enable reach-through interaction

  • Bouzbib, Elodie Lyath
  • Sarasate Azcona, Iosune
  • Fernández Ortega, Unai Javier
  • Fernández, Suárez, Iván
  • López-Amo Ocón, Manuel
  • Ezcurdia Aguirre, Íñigo Fermín
  • Marzo Pérez, Asier
Volumetric displays render true 3D graphics without forcing users to wear headsets or glasses. However, the optical diffusers that volumetric displays employ are rigid and thus do not allow for direct interaction. FlexiVol employs elastic diffusers to allow users to reach inside the display volume to have direct interaction with true 3D content. We explored various diffuser materials in terms of visual and mechanical properties. We correct the distortions of the volumetric graphics projected on elastic oscillating diffusers and propose a design space for FlexiVol, enabling various gestures and actions through direct interaction techniques. A user study suggests that selection, docking and tracing tasks can be performed faster and more precisely using direct interaction when compared to indirect interaction with a 3D mouse. Finally, applications such as a virtual pet or landscape edition highlight the advantages of a volumetric display that supports direct interaction.s)., This research was funded by the EU Horizon 2020 research and innovation programme under grant agreement No 101017746 TOUCHLESS, and by the European Research Consortium under grant agreement No 101042702 Intevol-ERC2021-STG.