Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 16
Encontrada(s) 1 página(s)

e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Towards automatic functional assessment in the EYEFUL project

  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Rubio Valverde, Ignacio
  • Arnau Herranz, Irene
Jornada de Investigación de IDISCAM 2024, 02/12/2024, Guadalajara, España., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

A proposal for automatic evaluation of human functional limitations in activities of daily living

  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Melino Carrero, Alessandro
  • Murillo Teruel, Marina
  • Calvo Del Castillo, Pablo
  • Fuente Lasa, Santiago de la
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Obeso Benítez, Paula
  • Martínez Piédrola, Rosa María
  • Pérez de Heredia Torres, Marta
This work presents a novel proposal aimed at automating the assessment of human functional limitations. It represents an interdisciplinary effort to develop and clinically evaluate an automated system for objective functional assessment, and is being carried out within the EYEFUL research project. Functional evaluation is a complex task that requires a holistic approach, considering various components like cognition, motor skills, and executive functions. The EYEFUL project has created an intelligent space within a fully equipped apartment, which includes the deployment of advanced technology (cameras, microphones, and wearable devices), to capture data from subjects undergoing assessment. In this paper, we provide an extensive overview of the project's architecture, including the selection of Activities of Daily Living (ADLs), the recruitment of subjects, the validation methodology, and the experimental setup. We describe the specialized apartment and sensor hardware deployed for data collection, along with the initial machine learning systems for data analysis. Additionally, we analyze the existing state-of-the-art research in automatic functional performance evaluation and present our proposal. This encompasses ADL selection, database design, recording considerations, and an overview of technological modules to be implemented. We also discuss the current status of select modules, including quantitative and qualitative results and references to ongoing work. In conclusion, the EYEFUL project is pioneering automated functional assessment, integrating advanced technology and interdisciplinary collaboration. It aims to provide healthcare professionals with accurate, comprehensive, and clinically validated evaluations of human functionality during ADLs, addressing the complex nature of functional limitations., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Towards automatic evaluation of human functional limitations: the EYEFUL project

  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Melino Carrero, Alessandro
  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Calvo del Castillo, Pablo
  • Monasterio Expósito, Leticia
  • Murillo Teruel, Marina
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Obeso Benítez, Paula
  • Hernández Hernández, Lucía
  • Redondo Cardeña, Beatriz
  • Yusta Ceacero, Aitor
  • Fernández Gómez, Gemma
  • Rodríguez Pérez, Pilar
  • García Bravo, Cristina
  • Serrada Tejeda, Sergio
  • Trugeda Pedrajo, Nuria
  • Morales Cabezas, Mª Matilde
  • Martínez Piédrola, Rosa María
  • Pérez de Heredia Torres, Marta
  • Valdez Disla, Leandro
30º Seminario Anual de Automática, Electrónica Industrial e Instrumentación (SAAEI 2023), 05/07/2023-07/07/2023, Sevilla, España., In this paper, the sensors deployment and data analysis for EYEFUL project are described, in order to generate a system for automatic human functional assessment. Human activity monitoring is a traditional topic of interest in different engineering areas, corresponding to the different applications and the sensorial systems used to tackle the task. In these extensive contexts, deep advances have been performed along the last decades, matching with the arrival of better sensors and processing technologies. Nowadays, artificial intelligence, machine learning, fast dedicated processors, as well as audiovisual cheap, small and precise sensors, and a huge amount of wearable systems available in the market have reinforced the solutions to this aim. In EYEFUL project, all of these different types of sensors are going to be used for human activity monitoring applied to the extraction of cues for analyzing the person performance of daily life activities, and in order to accomplish an assessment of its functional limitations. This aim is, as far as we know, still an open issue, although similar problems have recently opened other research lines, with audiovisual and wearables information (mainly in the context of smart cities and internet of things). The global architecture and methodology designed to tackle such problem in the sensible area of health, as well as the sensorial and processing system description, is included in the paper along with some preliminary results from the whole architecture deployed., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Introducing the ReaLISED dataset for sound event classification

  • Mohíno Herranz, María Inmaculada|||0000-0002-5144-3472
  • García Gómez, Joaquín
  • Aguilar Ortega, Miguel|||0000-0002-4661-7917
  • Utrilla Manso, Manuel|||0000-0003-2930-6049
  • Gil Pita, Roberto|||0000-0002-1790-3834
  • Rosa Zurera, Manuel|||0000-0002-3073-3278
This paper presents the Real-Life Indoor Sound Event Dataset (ReaLISED), a new database which has been developed to contribute to the scientific advance by providing a large amount of real labeled indoor audio event recordings. They offer the scientific community the possibility of testing Sound Event Classification (SEC) algorithms. The full set is made up of 2479 sound clips of 18 different events, which were recorded following a precise recording process described along the proposal. This, together with a described way of testing the similarity of new audio, makes the dataset scalable and opens up the door to its future growth, if desired by the researchers. The full set presents a good balance in terms of the number of recordings of each type of event, which is a desirable characteristic of any dataset. Conversely, the main limitation of the provided data is that all the audio is recorded in indoor environments, which was the aim behind this development. To test the quality of the dataset, both the intraclass and the interclass similarities were evaluated. The first has been studied through the calculation of the intraclass Pearson correlation coefficient and further discard of redundant audio, while the second one has been evaluated with the creation, training and testing of different classifiers: linear and quadratic discriminants, k-Nearest Neighbors (kNN), Support Vector Machines (SVM), Multilayer Perceptron (MLP), and Deep Neural Networks (DNN). Firstly, experiments were carried out over the entire dataset, and later over three different groups (impulsive sounds, non-impulsive sounds, and appliances) composed of six classes according to the results from the entire dataset. This clustering shows the usefulness of following a two-step classification process., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

3DFCNN: real-time action recognition using 3D deep neural networks with raw depth information

  • Sánchez Caballero, Adrián|||0000-0002-3395-7568
  • López Diz, Sergio de|||0000-0002-2463-4396
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Casillas Pérez, David|||0000-0002-5721-1242
  • Sarker, Mohammad Ibrahim
This work describes an end-to-end approach for real-time human action recognition from raw depth image-sequences. The proposal is based on a 3D fully convolutional neural network, named 3DFCNN, which automatically encodes spatio-temporal patterns from raw depth sequences. The described 3D-CNN allows actions classification from the spatial and temporal encoded information of depth sequences. The use of depth data ensures that action recognition is carried out protecting people"s privacy, since their identities can not be recognized from these data. The proposed 3DFCNN has been optimized to reach a good performance in terms of accuracy while working in real-time. Then, it has been evaluated and compared with other state-of-the-art systems in three widely used public datasets with different characteristics, demonstrating that 3DFCNN outperforms all the non-DNNbased state-of-the-art methods with a maximum accuracy of 83.6% and obtains results that are comparable to the DNN-based approaches, while maintaining a much lower computational cost of 1.09 seconds, what significantly increases its applicability in real-world environments., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Audiovisual tracking of multiple speakers in smart spaces

  • Sanabria Macías, Frank
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
This paper presents GAVT, a highly accurate audiovisual 3D tracking system based on particle filters and a probabilistic framework, employing a single camera and a microphone array. Our first contribution is a complex visual appearance model that accurately locates the speaker?s mouth. It transforms a Viola & Jones face detector classifier kernel into a likelihood estimator, leveraging knowledge from multiple classifiers trained for different face poses. Additionally, we propose a mechanism to handle occlusions based on the new likelihood?s dispersion. The audio localization proposal utilizes a probabilistic steered response power, representing cross-correlation functions as Gaussian mixture models. Moreover, to prevent tracker interference, we introduce a novel mechanism for associating Gaussians with speakers. The evaluation is carried out using the AV16.3 and CAV3D databases for Single- and Multiple-Object Tracking tasks (SOT and MOT, respectively). GAVT significantly improves the localization performance over audio-only and video- only modalities, with up to 50.3% average relative improvement in 3D when compared with the video-only modality. When compared to the state of the art, our audiovisual system achieves up to 69.7% average relative improvement for the SOT and MOT tasks in the AV16.3 dataset (2D comparison), and up to 18.1% average relative improvement in the MOT task for the CAV3D dataset (3D comparison)., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

A new framework for deep learning video based Human Action Recognition on the edge

  • Cob Parro, Antonio Carlos
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Gardel Vicente, Alfredo|||0000-0001-7887-4689
  • Bravo Muñoz, Ignacio|||0000-0002-6964-0036
Nowadays, video surveillance systems are commonly found in most public and private spaces. These systems typically consist of a network of cameras that feed into a central node. However, the processing aspect is evolving towards distributed approaches, leveraging edge-computing. These distributed systems are capable of effectively addressing the detection of people or events at each individual node. Most of these systems, rely on the use of deep-learning and segmentation algorithms which enable them to achieve high performance, but usually with a significant computational cost, hindering real-time execution. This paper presents an approach for people detection and action recognition in the wild, optimized for running on the edge, and that is able to work in real-time, in an embedded platform. Human Action Recognition (HAR) is performed by using a Recurrent Neural Network (RNN), specifically a Long Short-Term Memory (LSTM). The input to the LSTM is an ad-hoc, lightweight feature vector obtained from the bounding box of each detected person in the video surveillance image. The resulting system is highly portable and easily scalable, providing a powerful tool for real-world video surveillance applications (in the wild and real-time action recognition). The proposal has been exhaustively evaluated and compared against other state-of-the-art (SOTA) proposals in five datasets, including four widely used (KTH, WEIZMAN, WVU, IXMAX) and a novel one (GBA) recorded in the wild, that includes several people performing different actions simultaneously. The obtained results validate the proposal, since it achieves SOTA accuracy within a much more complicated video surveillance real scenario, and using a lightweight embedded hardware., European Commission, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Label augmentation to improve generalization of deep learning semantic segmentation of laparoscopic images

  • Monasterio Expósito, Leticia
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Macías Guarasa, Javier|||0000-0002-3303-3963
Training Deep Neural Networks to solve semantic segmentation is a challenging problem with small-size labeled datasets, leading to overfitting. This is especially problematic in medical images, and in particular, in laparoscopic surgery images. In this context, ground-truth segmentation labels are available only for a small set of images with few patients. Besides, inter-patient variability is very high in practice. Models trained for a specific setup and a set of patients usually performs poorly when deployed in a new environment. This work proposes a new training strategy that improves the generalization accuracy of current state-of-the-art semantic segmentation methods applied to laparoscopic images. Our approach is based on training a discriminator network, which learns to detect segmentation errors, producing a dense segmentation error map. Unlike in adversarial networks, we train the discriminator offline by synthetically altering ground- truth segmentation labels with simple morphological and geometric operations. We then use the discriminator to train a segmentation neural network, by minimizing the discriminator predicted error jointly with a standard segmentation loss. This strategy results in segmentation models that are significantly more accurate when tested in unseen images than those only relying on data augmentation. This technique is very suitable to boost the performance of any state-of-the-art segmentation network and can be combined with other data augmentation strategies. This paper evaluates and validates our proposal by training and testing common state-of-the-art segmentation models in publicly available semantic segmentation datasets, specialized in laparoscopic and endoscopic surgery. The results show that our methods are effective, obtaining a significant improvement in terms of segmentation accuracy, especially in challenging small-size datasets., Agencia Estatal de Investigación, Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Towards automatic assessment of quiet standing balance during the execution of ADLs

  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Monasterio Expósito, Leticia
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Murillo Teruel, Marina
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
24th International Conference, EAAAI/EANN 2023, León, Spain, June 14–17, 2023., The current method used to estimate the balance a person has during the performance of Activities of Daily Life (ADLs) is through the application of standardized scales used by occupational therapists to evaluate a person's motor skills and performance quality during those activities, such as the Assessment of Motor and Process Skills scale (AMPS). In this paper, we propose a method to automate the evaluation of a person's balance during the stage of quiet standing still while a person is completing an ADL. Our proposal is aimed to first estimate the projection of the person's center of mass (CoM) from the 3D position of the body joints by applying theoretical and deep learning approaches. Then, we aim to predict a clinically validated objective balance score from previous estimations of the CoM and the Center of Pressure (CoP), using different neural network models. While there are other proposals in the literature, the lack of publicly available datasets makes it difficult to do an extensive comparison, so we compare our proposal with state-of-the-art results in two publicly available datasets, improving their results., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Object detection for functional assessment applications

  • Melino Carrero, Alessandro
  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Guardiola Luna, Irene|||0000-0002-5218-4361
  • Baeza Mas, Javier
Engineering Applications of Neural Networks, EANN 2023, This paper presents a proposal for object detection as a first stage for the analysis of Human-Object Interaction (HOI) in the context of automated functional assessment. The proposed system is based in a two-step strategy, thus, in the first stage there are detected the people in the scene, as well as large objects (table, chairs, etc.) using a pre-trained YOLOv8. Then, there is defined a ROI around each person that is processed using a custom YOLO to detect small elements (forks, plates, spoons, etc.). Since there are no large image datasets that include all the objects of interest, there has also been compiled a new dataset including images from different sets, and improving the available labels. The proposal has been evaluated in the novel dataset, and in different images acquired in the area in which the functional assessment is performed, obtaining promising results., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Real-time human action recognition using raw depth video-based recurrent neural networks

  • Sánchez Caballero, Adrián|||0000-0002-3395-7568
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
This work proposes and compare two different approaches for real-time human action recognition (HAR) from raw depth video sequences. Both proposals are based on the convolutional long short-term memory unit, namely ConvLSTM, with differences in the architecture and the long-term learning. The former uses a video-length adaptive input data generator (stateless) whereas the latter explores the stateful ability of general recurrent neural networks but is applied in the particular case of HAR. This stateful property allows the model to accumulate discriminative patterns from previous frames without compromising computer memory. Furthermore, since the proposal uses only depth information, HAR is carried out preserving the privacy of people in the scene, since their identities can not be recognized. Both neural networks have been trained and tested using the large-scale NTU RGB+D dataset. Experimental results show that the proposed models achieve competitive recognition accuracies with lower computational cost compared with state-of-the-art methods and prove that, in the particular case of videos, the rarely-used stateful mode of recurrent neural networks significantly improves the accuracy obtained with the standard mode. The recognition accuracies obtained are 75.26% (CS) and 75.45% (CV) for the stateless model, with an average time consumption per video of 0.21 s, and 80.43% (CS) and 79.91%(CV) with 0.89 s for the stateful one., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

A hybrid cascade-parallel discriminative-generative model for pipeline integrity threat detection in a smart fiber optic surveillance system

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Martín López, Sonia|||0000-0001-5203-6206
  • González Herráez, Miguel|||0000-0003-2555-2971
This paper presents an advanced system for the continuous monitoring of potential threats in a long gas pipeline. For signal acquisition, phase-sensitive optical time domain reflectometry (phi-OTDR) technology is employed. Then, pattern recognition strategies are incorporated, which are aimed at identifying threats. To do so, the system integrates a random forest-based approach on top of a multiple-layer perceptron (MLP)-based discriminative approach for feature extraction within a parallel Gaussian Mixture Model (GMM)-Hidden Markov Model (HMM) for pattern classification in a hybrid approach. Subsequently, a system combination strategy, which makes use of the decisions carried out by this hybrid approach, is also presented. This strategy is based on the so-called majority voting technique, which makes use of the output of the classification step from the different feature extraction strategies and the different number of states in the GMM-HMM-based classification. The system is tested on two tasks: (1) Identification of machine and activity, and (2) detection of threats for the pipeline. Compared with our previous system, the results of this advanced system show that the hybrid feature extraction and pattern classification achieve statistically significant improvements for both tasks (i.e., 5% of relative improvement for the machine and activity identification task, 1% of relative improvement in the threat detection rate, and 15% of relative improvement in the false alarm rate for the threat detection task)., Ministerio de Ciencia e Innovación, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Artículo científico (JournalArticle)

Protocol for the development of automatic multisensory systems to analyze human activity for functional evaluation: application to the EYEFUL system

  • Obeso Benítez, Paula
  • Pérez de Heredia Torres, Marta
  • Huertas Hoyas, Elisabet
  • Sánchez Herrera-Baeza, Patricia
  • Máximo Bocanegra, Nuria
  • Serrada Tejada, Sergio
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Palazuelos Cagigas, Sira Elena|||0000-0002-2311-441X
  • Martín Sánchez, José Luis|||0000-0001-9311-3511
  • Martínez Piédrola, Rosa María
The EYEFUL system represents a pioneering initiative designed to leverage multisensory systems for the automatic evaluation of functional ability and determination of dependency status in people performing activities of daily living. This interdisciplinary effort, bridging the gap between engineering and health sciences, aims to overcome the limitations of current evaluation tools, which often lack objectivity and fail to capture the full range of functional capacity. Until now, it has been derived from subjective reports and observational methods. By integrating wearable sensors and environmental technologies, EYEFUL offers an innovative approach to quantitatively assess an individual’s ability to perform activities of daily living, providing a more accurate and unbiased evaluation of functionality and personal independence. This paper describes the protocol planned for the development of the EYEFUL system, from the initial design of the methodology to the deployment of multisensory systems and the subsequent clinical validation process. The implications of this research are far-reaching, offering the potential to improve clinical evaluations of functional ability and ultimately improve the quality of life of people with varying levels of dependency. With its emphasis on technological innovation and interdisciplinary collaboration, the EYEFUL system sets a new standard for objective evaluation, highlighting the critical role of advanced screening technologies in addressing the challenges of modern healthcare. We expect that the publication of the protocol will help similar initiatives by providing a structured approach and rigorous validation process., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Gaze orientation to evaluate object interaction in human functional assessment

  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
2023 IEEE 32nd International Symposium on Industrial Electronics (ISIE), 19-21 June 2023, Helsinki, Finland., The paper goal is to identify what and where each person, in a RGB image, is looking at, and correctly handle the case where the gaze target is out-of-frame. Human-Gaze-Target (HGT) projects mainly focus on ?Where the person is looking at? on video-surveillance RGB images, but fail to exploit ?What the person is looking at? in such context. On this document, we present a video-processing workflow that takes that step, fusing an accurate HGT algorithm with an object detection one, and enhancing the resulting system for the application of interest. Concretely, we introduce an algorithm called ?Looking at whose function is transforming the HGT output into a shape comparable to that of the object detection standard algorithms. We also propose the inclusion of a preprocessing layer into the object detection algorithm, in order to increase its confidence on detecting small items, typically used in functional assessment evaluation tasks (such as silverware), that is the application of interest of this proposal. Finally, we generate and use a novel dataset for validating the global workflow proposed, that has been recorded in a specially adapted kitchen for the assessment task, the EYEFUL dataset, obtaining promising quantitative and qualitative results., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Action recognition for functional assessment applications

  • Nieva Suárez, Álvaro|||0000-0003-3414-6721
  • Calvo del Castillo, Pablo
  • Melino Carrero, Alessandro
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Cob Parro, Antonio Carlos
30º Seminario Anual de Automática, Electrónica Industrial e Instrumentación (SAAEI 2023), 05/07/2023-07/07/2023, Sevilla, España., This paper presents two different Deep Learning (DL) proposals that have been proposed along with the specifically collected dataset GEFAD-HAR (GEintra Functional Assessment Dataset - Human Action Recognition) in order to extract action recognition information in the very special context of human functional assessment, that appeals in EYEFUL project (MICINN/AEI/10.13039/501100011033), in order to collaborate with professional occupational therapists within this subjective but important task. In the paper, the video dataset GEFADHAR is gathered from well known Human Activity Recognition (HAR) datasets, putting together videos of people performing actions required by occupational therapists to assess their patients functional capacity. The resulting GEFAD-HAR collection contains over 8000 videos, composing five different actions: squatting, sitting, falling, walking and standing. GEFAD-HAR videos have been selected from different public sources to keep and adapt such advantageous condition information for the application aimed. It must be emphasized that a meticulous manual data cleaning task has been performed within the dataset here presented, in order to have it well adapted to the application objective of interest, that to our knowledge has not been tackled like this in the state-of-the-art. Moreover, as mentioned, two different Deep Learning (DL) proposals are have also been recruited from the state-of-the art in order to propose a prove-ofconcept of the global automatic functional assessment algorithm pursued, within the data-gathered, with successful results that are also here presented. The global proposal (both the models and the database) will be published in the near future., Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publicación Contribución de congreso (ConferenceOutput)

Real-time weakly supervised anomaly detection with attention mechanism

  • Sarker, Mohammad Ibrahim
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
2023 International Conference on Information Network and Computer Communications (INCC), 27/10/2023-29/10/2023, Beijing, China., The use of surveillance cameras for ensuring the safety of people in public gatherings, e.g., roads, intersections, banks, shopping malls, etc., is being used increasingly in recent years. To detect violence and other abnormal behaviors from these surveillance videos, the monitoring, and detection need to be intelligent and precise. Manual monitoring of these videos is tiring and prone to errors. So automatic detection of video anomaly is a very important research topic nowadays. Although many methods have been proposed, research is still ongoing for a reliable method for violence detection. Most of the earlier state-of-the-art works suggest that supervised detection is better in anomaly detection than unsupervised one. However, given the difficulty of manually annotation and training large datasets for supervised learning, weakly supervised methods provide an excellent alternate solution. Generally, in weakly supervised learning, anomaly detection is constructed as a Multiple Instance Learning (MIL) problem. The base of that technique is to build the training model from labeled bags (comprising multiple instances) rather than labeled individual instances (in the computer vision branch: videos or frames). A bag is annotated as negative if all the instances are negative, while it is marked positive if at least one instance is positive. But the problem is that the recognition of positive instances is largely biased by the dominance of negative ones. As in the real world, abnormal events are very subtle, and the difference between normal and abnormal instances is minimal. Addressing this issue, this paper proposes a weakly supervised learning algorithm with an attention mechanism for anomalous events detection. Also, a novel ranking loss function is proposed to lessen the number of false negatives in the anomaly detection task and to extend the distance between classification scores of anomalous and normal videos in the learned model. Experimental results of this proposal within UCF-Crime and Shanghai-Tech datasets show that the proposed method outperforms state-of-the-art ones. Moreover, using an attention mechanism enhances feature extraction in the generated model inference. Finally, it is demonstrated that the proposal can be run in real-time, a contribution that can greatly impact real applications in the context of interest., Agencia Estatal de Investigación, Universidad de Alcalá