Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

A proposal for automatic evaluation of human functional limitations in activities of daily living

  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Melino Carrero, Alessandro
  • Murillo Teruel, Marina
  • Calvo Del Castillo, Pablo
  • Fuente Lasa, Santiago de la
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Obeso Benítez, Paula
  • Martínez Piédrola, Rosa María
  • Pérez de Heredia Torres, Marta
This work presents a novel proposal aimed at automating the assessment of human functional limitations. It represents an interdisciplinary effort to develop and clinically evaluate an automated system for objective functional assessment, and is being carried out within the EYEFUL research project. Functional evaluation is a complex task that requires a holistic approach, considering various components like cognition, motor skills, and executive functions. The EYEFUL project has created an intelligent space within a fully equipped apartment, which includes the deployment of advanced technology (cameras, microphones, and wearable devices), to capture data from subjects undergoing assessment. In this paper, we provide an extensive overview of the project's architecture, including the selection of Activities of Daily Living (ADLs), the recruitment of subjects, the validation methodology, and the experimental setup. We describe the specialized apartment and sensor hardware deployed for data collection, along with the initial machine learning systems for data analysis. Additionally, we analyze the existing state-of-the-art research in automatic functional performance evaluation and present our proposal. This encompasses ADL selection, database design, recording considerations, and an overview of technological modules to be implemented. We also discuss the current status of select modules, including quantitative and qualitative results and references to ongoing work. In conclusion, the EYEFUL project is pioneering automated functional assessment, integrating advanced technology and interdisciplinary collaboration. It aims to provide healthcare professionals with accurate, comprehensive, and clinically validated evaluations of human functionality during ADLs, addressing the complex nature of functional limitations., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Introducing the ReaLISED dataset for sound event classification

  • Mohíno Herranz, María Inmaculada|||0000-0002-5144-3472
  • García Gómez, Joaquín
  • Aguilar Ortega, Miguel|||0000-0002-4661-7917
  • Utrilla Manso, Manuel|||0000-0003-2930-6049
  • Gil Pita, Roberto|||0000-0002-1790-3834
  • Rosa Zurera, Manuel|||0000-0002-3073-3278
This paper presents the Real-Life Indoor Sound Event Dataset (ReaLISED), a new database which has been developed to contribute to the scientific advance by providing a large amount of real labeled indoor audio event recordings. They offer the scientific community the possibility of testing Sound Event Classification (SEC) algorithms. The full set is made up of 2479 sound clips of 18 different events, which were recorded following a precise recording process described along the proposal. This, together with a described way of testing the similarity of new audio, makes the dataset scalable and opens up the door to its future growth, if desired by the researchers. The full set presents a good balance in terms of the number of recordings of each type of event, which is a desirable characteristic of any dataset. Conversely, the main limitation of the provided data is that all the audio is recorded in indoor environments, which was the aim behind this development. To test the quality of the dataset, both the intraclass and the interclass similarities were evaluated. The first has been studied through the calculation of the intraclass Pearson correlation coefficient and further discard of redundant audio, while the second one has been evaluated with the creation, training and testing of different classifiers: linear and quadratic discriminants, k-Nearest Neighbors (kNN), Support Vector Machines (SVM), Multilayer Perceptron (MLP), and Deep Neural Networks (DNN). Firstly, experiments were carried out over the entire dataset, and later over three different groups (impulsive sounds, non-impulsive sounds, and appliances) composed of six classes according to the results from the entire dataset. This clustering shows the usefulness of following a two-step classification process., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

3DFCNN: real-time action recognition using 3D deep neural networks with raw depth information

  • Sánchez Caballero, Adrián|||0000-0002-3395-7568
  • López Diz, Sergio de|||0000-0002-2463-4396
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Casillas Pérez, David|||0000-0002-5721-1242
  • Sarker, Mohammad Ibrahim
This work describes an end-to-end approach for real-time human action recognition from raw depth image-sequences. The proposal is based on a 3D fully convolutional neural network, named 3DFCNN, which automatically encodes spatio-temporal patterns from raw depth sequences. The described 3D-CNN allows actions classification from the spatial and temporal encoded information of depth sequences. The use of depth data ensures that action recognition is carried out protecting people"s privacy, since their identities can not be recognized from these data. The proposed 3DFCNN has been optimized to reach a good performance in terms of accuracy while working in real-time. Then, it has been evaluated and compared with other state-of-the-art systems in three widely used public datasets with different characteristics, demonstrating that 3DFCNN outperforms all the non-DNNbased state-of-the-art methods with a maximum accuracy of 83.6% and obtains results that are comparable to the DNN-based approaches, while maintaining a much lower computational cost of 1.09 seconds, what significantly increases its applicability in real-world environments., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Audiovisual tracking of multiple speakers in smart spaces

  • Sanabria Macías, Frank
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
This paper presents GAVT, a highly accurate audiovisual 3D tracking system based on particle filters and a probabilistic framework, employing a single camera and a microphone array. Our first contribution is a complex visual appearance model that accurately locates the speaker?s mouth. It transforms a Viola & Jones face detector classifier kernel into a likelihood estimator, leveraging knowledge from multiple classifiers trained for different face poses. Additionally, we propose a mechanism to handle occlusions based on the new likelihood?s dispersion. The audio localization proposal utilizes a probabilistic steered response power, representing cross-correlation functions as Gaussian mixture models. Moreover, to prevent tracker interference, we introduce a novel mechanism for associating Gaussians with speakers. The evaluation is carried out using the AV16.3 and CAV3D databases for Single- and Multiple-Object Tracking tasks (SOT and MOT, respectively). GAVT significantly improves the localization performance over audio-only and video- only modalities, with up to 50.3% average relative improvement in 3D when compared with the video-only modality. When compared to the state of the art, our audiovisual system achieves up to 69.7% average relative improvement for the SOT and MOT tasks in the AV16.3 dataset (2D comparison), and up to 18.1% average relative improvement in the MOT task for the CAV3D dataset (3D comparison)., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

A new framework for deep learning video based Human Action Recognition on the edge

  • Cob Parro, Antonio Carlos
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Gardel Vicente, Alfredo|||0000-0001-7887-4689
  • Bravo Muñoz, Ignacio|||0000-0002-6964-0036
Nowadays, video surveillance systems are commonly found in most public and private spaces. These systems typically consist of a network of cameras that feed into a central node. However, the processing aspect is evolving towards distributed approaches, leveraging edge-computing. These distributed systems are capable of effectively addressing the detection of people or events at each individual node. Most of these systems, rely on the use of deep-learning and segmentation algorithms which enable them to achieve high performance, but usually with a significant computational cost, hindering real-time execution. This paper presents an approach for people detection and action recognition in the wild, optimized for running on the edge, and that is able to work in real-time, in an embedded platform. Human Action Recognition (HAR) is performed by using a Recurrent Neural Network (RNN), specifically a Long Short-Term Memory (LSTM). The input to the LSTM is an ad-hoc, lightweight feature vector obtained from the bounding box of each detected person in the video surveillance image. The resulting system is highly portable and easily scalable, providing a powerful tool for real-world video surveillance applications (in the wild and real-time action recognition). The proposal has been exhaustively evaluated and compared against other state-of-the-art (SOTA) proposals in five datasets, including four widely used (KTH, WEIZMAN, WVU, IXMAX) and a novel one (GBA) recorded in the wild, that includes several people performing different actions simultaneously. The obtained results validate the proposal, since it achieves SOTA accuracy within a much more complicated video surveillance real scenario, and using a lightweight embedded hardware., European Commission, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Label augmentation to improve generalization of deep learning semantic segmentation of laparoscopic images

  • Monasterio Expósito, Leticia
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Macías Guarasa, Javier|||0000-0002-3303-3963
Training Deep Neural Networks to solve semantic segmentation is a challenging problem with small-size labeled datasets, leading to overfitting. This is especially problematic in medical images, and in particular, in laparoscopic surgery images. In this context, ground-truth segmentation labels are available only for a small set of images with few patients. Besides, inter-patient variability is very high in practice. Models trained for a specific setup and a set of patients usually performs poorly when deployed in a new environment. This work proposes a new training strategy that improves the generalization accuracy of current state-of-the-art semantic segmentation methods applied to laparoscopic images. Our approach is based on training a discriminator network, which learns to detect segmentation errors, producing a dense segmentation error map. Unlike in adversarial networks, we train the discriminator offline by synthetically altering ground- truth segmentation labels with simple morphological and geometric operations. We then use the discriminator to train a segmentation neural network, by minimizing the discriminator predicted error jointly with a standard segmentation loss. This strategy results in segmentation models that are significantly more accurate when tested in unseen images than those only relying on data augmentation. This technique is very suitable to boost the performance of any state-of-the-art segmentation network and can be combined with other data augmentation strategies. This paper evaluates and validates our proposal by training and testing common state-of-the-art segmentation models in publicly available semantic segmentation datasets, specialized in laparoscopic and endoscopic surgery. The results show that our methods are effective, obtaining a significant improvement in terms of segmentation accuracy, especially in challenging small-size datasets., Agencia Estatal de Investigación, Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Real-time human action recognition using raw depth video-based recurrent neural networks

  • Sánchez Caballero, Adrián|||0000-0002-3395-7568
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
This work proposes and compare two different approaches for real-time human action recognition (HAR) from raw depth video sequences. Both proposals are based on the convolutional long short-term memory unit, namely ConvLSTM, with differences in the architecture and the long-term learning. The former uses a video-length adaptive input data generator (stateless) whereas the latter explores the stateful ability of general recurrent neural networks but is applied in the particular case of HAR. This stateful property allows the model to accumulate discriminative patterns from previous frames without compromising computer memory. Furthermore, since the proposal uses only depth information, HAR is carried out preserving the privacy of people in the scene, since their identities can not be recognized. Both neural networks have been trained and tested using the large-scale NTU RGB+D dataset. Experimental results show that the proposed models achieve competitive recognition accuracies with lower computational cost compared with state-of-the-art methods and prove that, in the particular case of videos, the rarely-used stateful mode of recurrent neural networks significantly improves the accuracy obtained with the standard mode. The recognition accuracies obtained are 75.26% (CS) and 75.45% (CV) for the stateless model, with an average time consumption per video of 0.21 s, and 80.43% (CS) and 79.91%(CV) with 0.89 s for the stateful one., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

A hybrid cascade-parallel discriminative-generative model for pipeline integrity threat detection in a smart fiber optic surveillance system

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Martín López, Sonia|||0000-0001-5203-6206
  • González Herráez, Miguel|||0000-0003-2555-2971
This paper presents an advanced system for the continuous monitoring of potential threats in a long gas pipeline. For signal acquisition, phase-sensitive optical time domain reflectometry (phi-OTDR) technology is employed. Then, pattern recognition strategies are incorporated, which are aimed at identifying threats. To do so, the system integrates a random forest-based approach on top of a multiple-layer perceptron (MLP)-based discriminative approach for feature extraction within a parallel Gaussian Mixture Model (GMM)-Hidden Markov Model (HMM) for pattern classification in a hybrid approach. Subsequently, a system combination strategy, which makes use of the decisions carried out by this hybrid approach, is also presented. This strategy is based on the so-called majority voting technique, which makes use of the output of the classification step from the different feature extraction strategies and the different number of states in the GMM-HMM-based classification. The system is tested on two tasks: (1) Identification of machine and activity, and (2) detection of threats for the pipeline. Compared with our previous system, the results of this advanced system show that the hybrid feature extraction and pattern classification achieve statistically significant improvements for both tasks (i.e., 5% of relative improvement for the machine and activity identification task, 1% of relative improvement in the threat detection rate, and 15% of relative improvement in the false alarm rate for the threat detection task)., Ministerio de Ciencia e Innovación, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Protocol for the development of automatic multisensory systems to analyze human activity for functional evaluation: application to the EYEFUL system

  • Obeso Benítez, Paula
  • Pérez de Heredia Torres, Marta
  • Huertas Hoyas, Elisabet
  • Sánchez Herrera-Baeza, Patricia
  • Máximo Bocanegra, Nuria
  • Serrada Tejada, Sergio
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Martínez Piédrola, Rosa María
The EYEFUL system represents a pioneering initiative designed to leverage multisensory systems for the automatic evaluation of functional ability and determination of dependency status in people performing activities of daily living. This interdisciplinary effort, bridging the gap between engineering and health sciences, aims to overcome the limitations of current evaluation tools, which often lack objectivity and fail to capture the full range of functional capacity. Until now, it has been derived from subjective reports and observational methods. By integrating wearable sensors and environmental technologies, EYEFUL offers an innovative approach to quantitatively assess an individual’s ability to perform activities of daily living, providing a more accurate and unbiased evaluation of functionality and personal independence. This paper describes the protocol planned for the development of the EYEFUL system, from the initial design of the methodology to the deployment of multisensory systems and the subsequent clinical validation process. The implications of this research are far-reaching, offering the potential to improve clinical evaluations of functional ability and ultimately improve the quality of life of people with varying levels of dependency. With its emphasis on technological innovation and interdisciplinary collaboration, the EYEFUL system sets a new standard for objective evaluation, highlighting the critical role of advanced screening technologies in addressing the challenges of modern healthcare. We expect that the publication of the protocol will help similar initiatives by providing a structured approach and rigorous validation process., Agencia Estatal de Investigación, Universidad de Alcalá