Pasar al contenido principal

REALIDAD AUMENTADA A TRAVES DE VARIOS CANALES SENSORIALES. APLICACION A PROCESOS DE ORIENTACION Y LOCALIZACION ESPACIAL

TIN2017-87044-R

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2017
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POLITÈCNICA DE VALÈNCIA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 16
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

A SLAM-based augmented reality app for the assessment of spatial short-term memory using visual and auditory stimuli

  • Juan, M. Carmen|||0000-0002-8764-1470
  • Mollá, Ramón|||0000-0003-0704-9336
  • Vivó, Roberto|||0000-0002-0751-4114
  • Mendez-Lopez, Magdalena
  • Fidalgo, Camino
  • Paramo, David
[EN] A SLAM-based Augmented Reality (AR) app has been designed, developed, and validated to assess spatial short-term memory. Our app can be used with visual and auditory stimuli and can run on mobile devices. It can be used in any indoor environment. The anchors and data of the app are persistently stored in the cloud. As an authoring tool, the type of stimulus, its number, and specific positions in the real environment can be customized for each session. A study involving 48 participants was carried out to analyze the performance outcomes comparing the location and remembering of stimuli in a real environment using visual versus auditory stimuli. The number of objects placed correctly was similar for the two different stimuli used. However, the group that used the auditory stimulus spent significantly more time completing the task and required significantly more attempts. The performance outcomes were independent of age and gender. For the auditory stimuli, correlations among all of the variables of the AR app and the variables of two other tasks (object-recall and map-pointing) were found. We also found that the greater the number of correctly placed auditory stimuli, the greater the perceived competence and the less mental effort required. The greater the number of errors, the less the perceived competence. Finally, the auditory stimuli are valid stimuli that may benefit the assessment of the memorization of spatial-auditory associations, but the memorization of spatial-visual associations is dominant, as our results suggest., We would like to thank all of the people who participated in the study. We would like to thank the editor and reviewers for their valuable suggestions. This work was funded mainly by MCIN/AEI/10.13039/501100011033/ and by "ERDF A way of making Europe" through the project AR3Senses (TIN2017-87044-R); other support was received from Gobierno de Aragon (research group S31_20D) and FEDER 2020-2022 "Construyendo Europa desde Aragon".
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Extended Reality to Assess Short-Term Spatial Memory - A Comparative Study of Mixed Reality, Augmented Reality, and Virtual Reality

  • Ponce, David
  • Mendez-Lopez, Magdalena
  • Lluch Crespo, Javier|||0000-0002-4317-0806
  • Juan, M. Carmen|||0000-0002-8764-1470
[EN] A Mixed Reality (MR) application using an optical see-through headset was developed to assess short-term spatial memory. A study with 29 participants was conducted. Data from this study were compared to two previous studies using mobile Augmented Reality (AR) and Virtual Reality (VR) with headsets. When comparing the three technologies (MR, AR, VR) for the performance variables, there were no statistically significant differences for either the total number of correctly placed objects or the total number of attempts. However, the MR application required more time than the AR and VR applications in the evaluation phase and more time than the VR application in the learning phase. Our arguments for the longer time are the novelty of the MR application for the participants and the characteristics of the applications. The key results from the MR study include the following: (1) the objects used in the MR application were correctly positioned on a map, which implies that the memory acquired with the MR application is effectively transferred to the user¿s mental map; (2) for the performance variables, there were no significant differences in the results by gender; (3) and the usability rating decreased with computer experience. The results show that the MR application is effective for spatial memory assessment and was well rated by the participants. The three technologies, along with suitable hardware, are effective for spatial memory assessment. However, MR using optical see-through headsets offers advantages over mobile AR and VR using headsets, discussed in this publication., This research was funded mainly by MCIN/AEI/10.13039/501100011033/ and by "ERDF A way of making Europe" through the project AR3Senses (TIN2017-87044-R).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Memory for Object Location in Augmented Reality: The Role of Gender and the Relationship Among Spatial and Anxiety Outcomes

  • Muñoz-Montoya, Francisco Miguel
  • Fidalgo, Camino
  • Mendez-Lopez, Magdalena
  • Juan, M. Carmen|||0000-0002-8764-1470
[EN] The potential of augmented reality (AR) technology for the study of spatial memory and orientation is a new research field. AR defines systems that attempt to enhance the user's experience with the physical world. In our app, we enhance the sense of sight by adding interactive 3D elements to the real environment. Our app can be used in any real environment so that the experimental conditions during the tasks and the way in which an individual navigates are similar to those used in real life. With AR, the experimenter has a high level of control of the task and can store the participant¿s responses accurately. The classical factors that influence an individual¿s performance on virtual spatial tasks are gender and cognitive factors. The influence of emotional factors on spatial performance has been studied more recently. Since AR tasks for the study of spatial memory and spatial orientation are new developments, little is known about the factors that are related to performance on tasks of this type. In our study, we tested 46 young adults (26 women) in an AR object-location task that was performed in a building. The participants had to memorize the position of eight virtual objects while they were walking through the environment. We also assessed the participants' performance on an object-recall task, a map-pointing task, and a paper-and-pencil spatial orientation task. The self-reported importance of different spatial strategies for wayfinding and the levels of trait anxiety and wayfinding anxiety were also evaluated. Our findings indicate that men performed better on the spatial paper-and-pencil test and spent more time completing the learning phase of the AR task. The spatial memory for the location of the objects in AR and on the map correlated positively. Anxiety was related to individual differences in the self-reported use of a spatial orientation strategy, but the association among them was weak. Trait anxiety was positively related to the time employed by the participants during the learning phase of the AR task, whereas wayfinding anxiety correlated negatively with the preference for an orientation strategy. Our results highlight the importance of anxiety in spatial orientation., This work was funded by: the Spanish Ministry of Economy, Industry and Competitiveness through the AR3Senses project (TIN2017-87044-R) and cofinanced by the ERDF (European Regional Development Fund); the Gobierno de Aragon (Departamento de Innovacion, Investigacion y Universidad) and FEDER "Construyendo Europa desde Aragon" for the research group S31_ 17D; the Fundacion Bancaria Ibercaja and Universidad de Zaragoza (JIUZ-2018-SOC-12).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Augmented Reality to Assess Short-Term Spatial Memory: A Comparative Study of Olfactory, Visual, and Tactile Stimuli

  • Ponce, David
  • Torres, Celia
  • Mendez-Lopez, Magdalena
  • Mollá, Ramón|||0000-0003-0704-9336
  • Juan, M. Carmen|||0000-0002-8764-1470
[EN] This work presents an Augmented Reality application based on SLAM (Simultaneous Localization and Mapping) for the assessment of spatial memory involving olfactory stimuli. A study was carried with twenty-five adults. The participants of the study completed two phases (a learning phase and an evaluation phase). In the learning phase, the participants physically walk around a real environment and have to remember the location of olfactory stimuli. In the evaluation phase, the participants have to remember the location of olfactory stimuli learned in the previous phase. The data of this study is compared with those obtained in a previous study involving visual and tactile stimuli (N = 47). The results indicate that the olfactory stimuli did not offer significant differences with respect to the visual stimuli for the correct placement of stimuli and the number of attempts in the evaluation phase. The olfactory stimuli had better results compared to the tactile stimuli for the correct placement of the stimuli in the evaluation phase and there was a significantly lower number of attempts. The time required in the learning and evaluation phases was greater for the olfactory stimuli compared to the other two stimuli, which is justified by the physical and mechanical characteristics of each of the stimuli. The results show that this type of memory task for the olfactory stimuli is independent of gender and age. All of these results suggest that olfactory stimuli are valid stimuli for assessing the memorization of olfactory-spatial associations and are similar to the level of visual stimuli and better than tactile stimuli., This work was supported by FEDER/Ministerio de Ciencia e Innovación-Agencia Estatal de Investigación/AR3Senses funding for open access charge Universitat Politècnica de València under Grant TIN2017-87044-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

How people with brain injury run and evaluate a SLAM-based smartphone augmented reality application to assess object-location memory

  • Mendez-Lopez, M.
  • Burgos, Teresa
  • Mendez, Marta
  • Fidalgo, Camino
  • Juan, M. Carmen|||0000-0002-8764-1470
[EN] Augmented reality (AR) technology allows virtual objects to be superimposed on the real-world environment, offering significant potential for improving cognitive assessments and rehabilitation processes in the field of visuospatial learning. This study examines how patients with acquired brain injury (ABI) evaluate the functions and usability of a SLAM-based smartphone AR app to assess object-location skills. Ten ABI patients performed a task for the spatial recall of four objects using an AR app. The data collected from 10 healthy participants provided reference values for the best performance. Their perceptions of the AR app/technology and its usability were investigated. The results indicate lower effectiveness in solving the task in the patient group, as the time they needed to complete it was related to their level of impairment. The patients showed lower, yet positive, scores in factors related to app usability and acceptance (e.g., mental effort and satisfaction, respectively). There were more patients reported on entertainment as a positive aspect of the app. Patients' perceived enjoyment was related to concentration and calm, whereas usability was associated with perceived competence, expertise, and a lower level of physical effort. For patients, the sensory aspects of the objects were related to their presence, while for healthy participants, they were related to enjoyment and required effort. The results show that AR seems to be a promising tool to assess spatial orientation in the target patient population., Gobierno de Aragon (Departamento de Ciencia,Universidad y Sociedad del Conocimiento), Grant/Award Number: under research group S31_23R; MCIN/ AEI /10.13039/501100011033/and by "ERDF A way of making Europe" throughthe project AR3Senses, Grant/Award Number:TIN2017-87044-R
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

SLAM-based augmented reality for the assessment of short-term spatial memory. A comparative study of visual versus tactile stimuli

  • Muñoz-Montoya, Francisco Miguel
  • Mendez-Lopez, Magdalena
  • Fidalgo, Camino
  • Juan, M. Carmen|||0000-0002-8764-1470
  • Mollá, Ramón|||0000-0003-0704-9336
  • Abad Cerdá, Francisco José|||0000-0001-5896-8645
[EN] The assessment of human spatial short-term memory has mainly been performed using visual stimuli and less frequently using auditory stimuli. This paper presents a framework for the development of SLAM-based Augmented Reality applications for the assessment of spatial memory. An AR mobile application was developed for this type of assessment involving visual and tactile stimuli by using our framework. The task to be carried out with the AR application is divided into two phases: 1) a learning phase, in which participants physically walk around a room and have to remember the location of simple geometrical shapes; and 2) an evaluation phase, in which the participants are asked to recall the location of the shapes. A study for comparing the performance outcomes using visual and tactile stimuli was carried out. Fifty-three participants performed the task using the two conditions (Tactile vs Visual), but with more than two months of difference (within-subject design). The number of shapes placed correctly was similar for both conditions. However, the group that used the tactile stimulus spent significantly more time completing the task and required significantly more attempts. The performance outcomes were independent of gender. Some significant correlations among variables related to the performance outcomes and other tests were found. The following significant correlations among variables related to the performance outcomes using visual stimuli and the participants¿ subjective variables were also found: 1) the greater the number of correctly placed shapes, the greater the perceived competence; 2) the more attempts required, the less the perceived competence. We also found that perceived enjoyment was higher when a higher sense of presence was induced. Our results suggest that tactile stimuli are valid stimuli to exploit for the assessment of the ability to memorize spatial-tactile associations, but that the ability to memorize spatial-visual associations is dominant. Our results also show that gender does not affect these types of memory tasks., This work was funded mainly by FEDER/Ministerio de Ciencia e Innovacion - Agencia Estatal de Investigacion/AR3Senses (TIN2017-87044-R); other support was received from the Generalitat Valenciana/Fondo Social Europeo (ACIF/2019/031); the Gobierno de Aragon (research group S31_20D) and FEDER 2020-2022 "Construyendo Europa desde Aragon". The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

A virtual reality photography application to assess spatial memory

  • Juan, M. Carmen|||0000-0002-8764-1470
  • Lluch Crespo, Javier|||0000-0002-4317-0806
  • Vivó, Roberto|||0000-0002-0751-4114
  • Estevan, Miguel
  • Mendez-Lopez, Magdalena
  • Fidalgo, Camino
[EN] In this paper, the first virtual reality (VR) photography application that incorporates elements on panoramic images to assess short-term spatial memory is presented. It also allows the interaction with these elements. A study was conducted (N = 50) to compare participants' performance outcomes and subjective experience when using a VR application with and without panoramic photography. The results show that both applications are effective in assessing short-term spatial memory. The results with panoramic photography include: 1) It was effective for short-term recall since, after using the application, the participants were able to verbally recall the objects and place them without significant differences with respect to the objects correctly placed; 2) The performance outcomes were independent of age and gender; 3) The perceived level of presence was directly related to experiencing less cybersickness when using the application; 4) The level of satisfaction was directly related to perceived enjoyment, concentration, usability, competence, calmness, and expertise; 5) The more the familiarity with VR applications, the less the perceived cybersickness. Finally, the application offers two main advantages: 1) The evaluators can customize the environment by adding as many elements as desired to the panoramic photograph; 2) It could be especially suitable for groups with reduced mobility., MCIN/AEI/10.13039/501100011033/and "ERDF A way of making Europe" through the project AR3Senses (TIN2017-87044-R); Gobierno de Aragon and FEDER 2020-2022 "Construyendo Europa desde Aragon" (research group S31_20D).
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Augmented Reality Based on SLAM to Assess Spatial Short-Term Memory

  • Munoz-Montoya, F.
  • Juan, M.C.
  • Mendez-Lopez, M.
  • Alvarez Fidalgo, C.
Spatial short-term memory is defined as the limited ability of people to retain and remember the location of elements for short periods of time. In this paper, we present the first AR app based on SLAM (Simultaneous Localization and Mapping) to assess spatial short-term memory. A total of 55 participants were involved in a study for remembering the real place where four virtual objects were located in the real environment. The participants were divided into two groups: the ARGroup (the participants learned the location of the virtual objects in the real environment in an adaptation phase using AR) and the NoARGroup (the participants learned the location of the objects by looking at photographs). The results indicated that the performance outcomes in remembering objects and their location for the participants in the ARGroup were statistically significantly greater than those obtained by the participants in the NoARGroup. From this result and our observations, we can conclude that touring the augmented environment helped the participants to better remember the location of virtual objects added to the real scene compared to looking at photographs of the environment. Furthermore, statistically significant differences were not found in relation to gender or age. Finally, our app has several advantages: 1) Our app works in any environment and does not require adding real elements to the environment; 2) the evaluators can select any real environment and place the virtual elements where they want and even change them between sessions; and 3) our app could work similar to the way spatial memory does in everyday life.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Memory for Object Location in Augmented Reality: The Role of Gender and the Relationship Among Spatial and Anxiety Outcomes

  • Muñoz-Montoya, F.
  • Fidalgo, C.
  • Juan, M.C.
  • Méndez-López, M.
The potential of augmented reality (AR) technology for the study of spatial memory and orientation is a new research field. AR defines systems that attempt to enhance the user's experience with the physical world. In our app, we enhance the sense of sight by adding interactive 3D elements to the real environment. Our app can be used in any real environment so that the experimental conditions during the tasks and the way in which an individual navigates are similar to those used in real life. With AR, the experimenter has a high level of control of the task and can store the participant's responses accurately. The classical factors that influence an individual's performance on virtual spatial tasks are gender and cognitive factors. The influence of emotional factors on spatial performance has been studied more recently. Since AR tasks for the study of spatial memory and spatial orientation are new developments, little is known about the factors that are related to performance on tasks of this type. In our study, we tested 46 young adults (26 women) in an AR object-location task that was performed in a building. The participants had to memorize the position of eight virtual objects while they were walking through the environment. We also assessed the participants' performance on an object-recall task, a map-pointing task, and a paper-and-pencil spatial orientation task. The self-reported importance of different spatial strategies for wayfinding and the levels of trait anxiety and wayfinding anxiety were also evaluated. Our findings indicate that men performed better on the spatial paper-and-pencil test and spent more time completing the learning phase of the AR task. The spatial memory for the location of the objects in AR and on the map correlated positively. Anxiety was related to individual differences in the self-reported use of a spatial orientation strategy, but the association among them was weak. Trait anxiety was positively related to the time employed by the participants during the learning phase of the AR task, whereas wayfinding anxiety correlated negatively with the preference for an orientation strategy. Our results highlight the importance of anxiety in spatial orientation.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Wayfinding Strategy and Gender - Testing the Mediating Effects of Wayfinding Experience, Personality and Emotions

  • Mendez-Lopez, Magdalena
  • Fidalgo, Camino
  • Osma, Jorge
  • Juan, M Carmen
Background: Individual differences have been seen to play a key role in spatial orientation. Gender implications have been previously described but little is known about how other variables, such as wayfinding anxiety, emotional difficulties and wayfinding experience can mediate this relationship. Methods: A group of 269 participants were involved in this study and completed questionnaires on their self-reported allocentric orientation strategy, wayfinding experience and satisfaction with the ability for wayfinding. Emotional outcomes were also investigated: spatial and trait anxiety, neuroticism, difficulties in emotion regulation, and personal safety. First, a principal component analysis was conducted and the studied variables were grouped into four components: outdoor wayfinding experience, wayfinding-related fear, emotional difficulties, and effective wayfinding skill. Afterwards, structural equation modelling was performed, using the MPLUS statistical program. Results: The results showed that gender constitutes a predictor for using an effective wayfinding skill and for feeling wayfinding-related fear. However, outdoor wayfinding experience, wayfinding-related fear and emotional difficulties did not mediate the relationship between effective wayfinding skill and gender. Conclusion: These results highlight the differential contribution of gender in the emotions that are experienced during spatial orientation and emotions that are related to other types of situations. The limitations, strengths and theoretical implications of the proposed model are discussed. Further investigation is needed in order to understand the role of emotions in spatial orientation.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

SLAM-based augmented reality for the assessment of short-Term spatial memory. A comparative study of visual versus tactile stimuli

  • Munoz-Montoya, F.
  • Carmen Juan, M.
  • Mendez-Lopez, M.
  • Molla, R.
  • Abad, F.
  • Fidalgo, C.
The assessment of human spatial short-Term memory has mainly been performed using visual stimuli and less frequently using auditory stimuli. This paper presents a framework for the development of SLAM-based Augmented Reality applications for the assessment of spatial memory. An AR mobile application was developed for this type of assessment involving visual and tactile stimuli by using our framework. The task to be carried out with the AR application is divided into two phases: 1) a learning phase, in which participants physically walk around a room and have to remember the location of simple geometrical shapes; and 2) an evaluation phase, in which the participants are asked to recall the location of the shapes. A study for comparing the performance outcomes using visual and tactile stimuli was carried out. Fifty-Three participants performed the task using the two conditions (Tactile vs Visual), but with more than two months of difference (within-subject design). The number of shapes placed correctly was similar for both conditions. However, the group that used the tactile stimulus spent significantly more time completing the task and required significantly more attempts. The performance outcomes were independent of gender. Some significant correlations among variables related to the performance outcomes and other tests were found. The following significant correlations among variables related to the performance outcomes using visual stimuli and the participants subjective variables were also found: 1) the greater the number of correctly placed shapes, the greater the perceived competence; 2) the more attempts required, the less the perceived competence. We also found that perceived enjoyment was higher when a higher sense of presence was induced. Our results suggest that tactile stimuli are valid stimuli to exploit for the assessment of the ability to memorize spatial-Tactile associations, but that the ability to memorize spatial-visual associations is dominant. Our results also show that gender does not affect these types of memory tasks.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Visual vs auditory augmented reality for indoor guidance

  • Calle-Bustos, A.M.
  • Juan, J.
  • Abad, F.
  • Dias, P.
  • Méndez-López, M.
  • Carmen Juan, M.
Indoor navigation systems are not widely used due to the lack of effective indoor tracking technology. Augmented Reality (AR) is a natural medium for presenting information in indoor navigation tools. However, augmenting the environment with visual stimuli may not always be the most appropriate method to guide users, e.g., when they are performing some other visual task or they suffer from visual impairments. This paper presents an AR app to support visual and auditory stimuli that we have developed for indoor guidance. A study (N=20) confirms that the participants reached the target when using two types of stimuli, visual and auditory. The AR visual stimuli outperformed the auditory stimuli in terms of time and overall distance travelled. However, the auditory stimuli forced the participants to pay more attention, and this resulted in better memorization of the route. These performance outcomes were independent of gender and age. Therefore, in addition to being easy to use, auditory stimuli promote route retention and show potential in situations in which vision cannot be used as the primary sensory channel or when spatial memory retention is important. We also found that perceived physical and mental efforts affect the subjective perception about the AR guidance app.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Evaluation of an augmented reality application for learning neuroanatomy in psychology

  • Mendez-Lopez, Magdalena
  • Juan, M.Carmen
  • Molla, Ramón
  • Fidalgo, Camino
Neuroanatomy is difficult for psychology students because of spatial visualization and the relationship among brain structures. Some technologies have been implemented to facilitate the learning of anatomy using three-dimensional (3D) visualization of anatomy contents. Augmented reality (AR) is a promising technology in this field. A mobile AR application to provide the visualization of morphological and functional information of the brain was developed. A sample of 67 students of neuropsychology completed tests for visuospatial ability, anatomical knowledge, learning goals, and experience with technologies. Subsequently, they performed a learning activity using one of the visualization methods considered: a 3D method using the AR application and a two-dimensional (2D) method using a textbook to color, followed by questions concerning their satisfaction and knowledge. After using the alternative method, the students expressed their preference. The two methods improved knowledge equally, but the 3D method obtained higher satisfaction scores and was more preferred by students. The 3D method was also more preferred by the students who used this method during the activity. After controlling for the method used in the activity, associations were found between the preference of the 3D method because of its usability and experience with technologies. These results found that the AR application was highly valued by students to learn and was as effective as the textbook for this purpose.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

A SLAM-based augmented reality app for the assessment of spatial short-term memory using visual and auditory stimuli

  • Juan, M. Carmen
  • Méndez López, Magdalena
  • Álvarez Fidalgo, Camino
  • Molla, Ramón
  • Vivo, Robert
  • Páramo, David
A SLAM-based Augmented Reality (AR) app has been designed, developed, and validated to assess spatial short-term memory. Our app can be used with visual and auditory stimuli and can run on mobile devices. It can be used in any indoor environment. The anchors and data of the app are persistently stored in the cloud. As an authoring tool, the type of stimulus, its number, and specific positions in the real environment can be customized for each session. A study involving 48 participants was carried out to analyze the performance outcomes comparing the location and remembering of stimuli in a real environment using visual versus auditory stimuli. The number of objects placed correctly was similar for the two different stimuli used. However, the group that used the auditory stimulus spent significantly more time completing the task and required significantly more attempts. The performance outcomes were independent of age and gender. For the auditory stimuli, correlations among all of the variables of the AR app and the variables of two other tasks (object-recall and map-pointing) were found. We also found that the greater the number of correctly placed auditory stimuli, the greater the perceived competence and the less mental effort required. The greater the number of errors, the less the perceived competence. Finally, the auditory stimuli are valid stimuli that may benefit the assessment of the memorization of spatial-auditory associations, but the memorization of spatial-visual associations is dominant, as our results suggest.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

How people with brain injury run and evaluate a SLAM-based smartphone augmented reality application to assess object-location memory

  • Mendez-Lopez, Magdalena
  • Juan, M.-Carmen
  • Burgos, Teresa
  • Mendez, Marta
  • Álvarez Fidalgo, Camino
Augmented reality (AR) technology allows virtual objects to be superimposed on the real‐world environment, offering significant potential for improving cognitive assessments and rehabilitation processes in the field of visuospatial learning. This study examines how patients with acquired brain injury (ABI) evaluate the functions and usability of a SLAM‐based smartphone AR app to assess object‐location skills. Ten ABI patients performed a task for the spatial recall of four objects using an AR app. The data collected from 10 healthy participants provided reference values for the best performance. Their perceptions of the AR app/technology and its usability were investigated. The results indicate lower effectiveness in solving the task in the patient group, as the time they needed to complete it was related to their level of impairment. The patients showed lower, yet positive, scores in factors related to app usability and acceptance (e.g., mental effort and satisfaction, respectively). There were more patients reported on entertainment as a positive aspect of the app. Patients' perceived enjoyment was related to concentration and calm, whereas usability was associated with perceived competence, expertise, and a lower level of physical effort. For patients, the sensory aspects of the objects were related to their presence, while for healthy participants, they were related to enjoyment and required effort. The results show that AR seems to be a promising tool to assess spatial orientation in the target patient population.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Extended Reality to Assess Short-Term Spatial Memory—A Comparative Study of Mixed Reality, Augmented Reality, and Virtual Reality

  • Ponce, David
  • Mendez-Lopez, Magdalena
  • Lluch, Javier
  • Juan, M.-Carmen
A Mixed Reality (MR) application using an optical see-through headset was developed to assess short-term spatial memory. A study with 29 participants was conducted. Data from this study were compared to two previous studies using mobile Augmented Reality (AR) and Virtual Reality (VR) with headsets. When comparing the three technologies (MR, AR, VR) for the performance variables, there were no statistically significant differences for either the total number of correctly placed objects or the total number of attempts. However, the MR application required more time than the AR and VR applications in the evaluation phase and more time than the VR application in the learning phase. Our arguments for the longer time are the novelty of the MR application for the participants and the characteristics of the applications. The key results from the MR study include the following: (1) the objects used in the MR application were correctly positioned on a map, which implies that the memory acquired with the MR application is effectively transferred to the user’s mental map; (2) for the performance variables, there were no significant differences in the results by gender; (3) and the usability rating decreased with computer experience. The results show that the MR application is effective for spatial memory assessment and was well rated by the participants. The three technologies, along with suitable hardware, are effective for spatial memory assessment. However, MR using optical see-through headsets offers advantages over mobile AR and VR using headsets, discussed in this publication.