Skip to main content

DETECCION SEMANTICA MULTISENSORIAL DE SITUACIONES ANOMALAS EN ENTORNOS SIN RESTRICCIONES

TIN2016-75982-C2-1-R

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos I+D+i Retos de Investigación
Call year 2016
State Plan 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSIDAD DE ALCALA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 26
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication

A Novel Fiber Optic Based Surveillance System for Prevention of Pipeline Integrity Threats

  • Tejedor, Javier
  • Macías-Guarasa, Javier
  • Martins, Hugo F.
  • Piote, Daniel
  • Pastor-Graells, Juan
  • Martín-López, Sonia
  • Corredera, Pedro
  • González-Herráez, Miguel
This paper presents a novel surveillance system aimed at the detection and classification of threats in the vicinity of a long gas pipeline. The sensing system is based on phase-sensitive optical time domain reflectometry (<i>ϕ</i>-OTDR) technology for signal acquisition and pattern recognition strategies for threat identification. The proposal incorporates contextual information at the feature level and applies a system combination strategy for pattern classification. The contextual information at the feature level is based on the tandem approach (using feature representations produced by discriminatively-trained multi-layer perceptrons) by employing feature vectors that spread different temporal contexts. The system combination strategy is based on a posterior combination of likelihoods computed from different pattern classification processes. The system operates in two different modes: (1) machine + activity identification, which recognizes the activity being carried out by a certain machine, and (2) threat detection, aimed at detecting threats no matter what the real activity being conducted is. In comparison with a previous system based on the same rigorous experimental setup, the results show that the system combination from the contextual feature information improves the results for each individual class in both operational modes, as well as the overall classification accuracy, with statistically-significant improvements., Some authors were supported by funding from the European Research Council through Starting Grant UFINE (Grant Number #307441), Water JPI, the WaterWorks2014 Co-funded Call, the European Commission (Horizon 2020) through Project H2020-MSCA-ITN-2016/722509-FINESSE, the Spanish Ministry of Economy and Competitivity, the Spanish “Plan Nacional de I+D+i” through Projects TEC2013-45265-R, TEC2015-71127-C2-2-R, TIN2013-47630-C2-1-R and TIN2016-75982-C2-1-R, and the regional program SINFOTONCM: S2013/MIT-2790, funded by the “Comunidad de Madrid”. H.F.M. acknowledges funding through the FP7 ITN ICONE program, Grant #608099 funded by the European Commission. J.P.-G. acknowledges funding from the Spanish Ministry of Economy and Competitivity through an FPI contract. S.M.-L. acknowledges funding from the Spanish Ministry of Science and Innovation through a “Ramón y Cajal” contract., We acknowledge support by the CSIC Open Access Publication Initiative through its Unit of Information Resources for Research (URICI).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Machine Learning Methods for Pipeline Surveillance Systems Based on Distributed Acoustic Sensing: A Review

  • Tejedor, Javier
  • Macías-Guarasa, Javier
  • Martins, Hugo F.
  • Pastor-Graells, Juan
  • Corredera, Pedro
  • Martín-López, Sonia
There is an increasing interest in researchers and companies on the combination of Distributed Acoustic Sensing (DAS) and a Pattern Recognition System (PRS) to detect and classify potentially dangerous events that occur in areas above fiber optic cables deployed along active pipelines, aiming to construct pipeline surveillance systems. This paper presents a review of the literature in what respect to machine learning techniques applied to pipeline surveillance systems based on DAS+PRS (although its scope can also be extended to any other environment in which DAS+PRS strategies are to be used). To do so, we describe the fundamentals of the machine learning approaches when applied to DAS systems, and also do a detailed literature review of the main contributions on this topic. Additionally, this paper addresses the most common issues related to real field deployment and evaluation of DAS+PRS for pipeline threat monitoring, and intends to provide useful insights and recommendations in what respect to the design of such systems. The literature review concludes that a real field deployment of a PRS based on DAS technology is still a challenging area of research, far from being fully solved., Some authors were supported by funding from the European Research Council through Starting Grant UFINE (grant number #307441), Water JPI, the WaterWorks2014 Cofunded Call, the European Commission (Horizon 2020) through project H2020-MSCA-ITN-2016/722509-FINESSE, the Spanish Ministry of Economy and Competitiveness, the Spanish “Plan Nacional de I+D+i” through projects TEC2013-45265-R, TEC2015-71127-C2-2-R, TIN2013-47630-C2-1-R, and TIN2016-75982-C2-1-R, and the regional program SINFOTONCM: S2013/MIT-2790 funded by the “Comunidad de Madrid”. H.F.M. acknowledges funding through the FP7 ITN ICONE program, grant number #608099 funded by the European Commission. J.P.-G. acknowledges funding from the Spanish Ministry of Economy and Competivity through an FPI contract. SML acknowledges funding from the Spanish Ministry of Science and Innovation through a “Ramón y Cajal” contract., We acknowledge support by the CSIC Open Access Publication Initiative through its Unit of Information Resources for Research (URICI).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A multi-poosition approach in a smart fiber-optic surveillance system for pipeline integrity threat detection

  • Tejedor, Javier
  • Macías-Guarasa, Javier
  • Martins, Hugo F.
  • Martín-López, Sonia
  • González-Herráez, Miguel
19 pags., 4 figs., 9 tabs. -- This article belongs to the Special Issue Pattern Recognition and Applications, We present a new pipeline integrity surveillance system for long gas pipeline threat detection and classification. The system is based on distributed acoustic sensing with phase-sensitive optical time domain reflectometry (ϕ-OTDR) and pattern recognition for event classification. The proposal incorporates a multi-position approach in a Gaussian Mixture Model (GMM)-based pattern classification system which operates in a real-field scenario with a thorough experimental procedure. The objective is exploiting the availability of vibration-related data at positions nearby the one actually producing the main disturbance to improve the robustness of the trained models. The system integrates two classification tasks: (1) machine + activity identification, which identifies the machine that is working over the pipeline along with the activity being carried out, and (2) threat detection, which aims to detect suspicious threats for the pipeline integrity (independently of the activity being carried out). For the machine + activity identification mode, the multi-position approach for model training obtains better performance than the previously presented single-position approach for activities that show consistent behavior and high energy (between 6% and 11% absolute) with an overall increase of 3% absolute in the classification accuracy. For the threat detection mode, the proposed approach gets an 8% absolute reduction in the false alarm rate with an overall increase of 4.5% absolute in the classification accuracy., This research was funded by a private research project by Fluxys, Gassco and Statoil named “PIT-STOP (Early detection of Pipeline Integrity Threats using a SmarT fiber-OPtic surveillance system)”, by the Spanish Ministry of Economy and Competitiveness under projects HEIMDALUAH (TIN2016-75982-C2-1-R) and ARTEMISA (TIN2016-80939-R), by the University of Alcalá under projects ACUFANO (CCG19/IA-024) and ARGOS (CCG20/IA-043), and by the Spanish Ministry of Science, Innovation and Universities (IJCI-2017-33856 and RTI2018-097957-B-C33). The APC was funded by the Ministry of Science, Innovation and Universities of Spain grant number RTI2018-095324-B-I00., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A hybrid cascade-parallel discriminative-generative model for pipeline integrity threat detection in a smart fiber optic surveillance system

  • Tejedor, Javier
  • Macias-Guarasa, Javier
  • Martins, Hugo F.
  • Martín-López, Sonia
  • González-Herráez, Miguel
25 pags., 10 figs., 8 tabs., This paper presents an advanced system for the continuous monitoring of potential threats in a long gas pipeline. For signal acquisition, phase-sensitive optical time domain reflectometry (ϕ-OTDR) technology is employed. Then, pattern recognition strategies are incorporated, which are aimed at identifying threats. To do so, the system integrates a random forest-based approach on top of a multiple-layer perceptron (MLP)-based discriminative approach for feature extraction within a parallel Gaussian Mixture Model (GMM)-Hidden Markov Model (HMM) for pattern classification in a hybrid approach. Subsequently, a system combination strategy, which makes use of the decisions carried out by this hybrid approach, is also presented. This strategy is based on the so-called majority voting technique, which makes use of the output of the classification step from the different feature extraction strategies and the different number of states in the GMM-HMM-based classification. The system is tested on two tasks: (1) Identification of machine and activity, and (2) detection of threats for the pipeline. Compared with our previous system, the results of this advanced system show that the hybrid feature extraction and pattern classification achieve statistically significant improvements for both tasks (i.e., 5% of relative improvement for the machine and activity identification task, 1% of relative improvement in the threat detection rate, and 15% of relative improvement in the false alarm rate for the threat detection task)., This work was partially supported by the Ministry of Science, Innovation and Universities of Spain (grant number RTI2018-095324-B-I00).This work was also funded by the Spanish Ministry of Economy and Competitiveness with projects ARTEMISA (TIN2016-80939-R) and HEIMDAL-UAH (TIN201675982-C2-1-R), by the Spanish Ministry of Science and Innovation MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR program, with projects PSI (PLEC2021-007875),ATHENA (PID2020-115995RB-I00) and EYEFUL (PID2020-113118RB-C31), and by CAM and UAH under projects ARGOS+ (PIUAH21/IA-016) and CONDORDIA (CM/JIN/2021-015). The authors gratefully acknowledge the computer resources at Artemisa, funded by the European Union ERDF and Comunitat Valenciana as well as the technical support provided by the Instituto de Fisica Corpuscular, IFIC (CSIC-UV). The authors thank Sira E. Palazuelos-Cagigas for her participation in the writing and technical editing of the manuscript., Peer reviewed
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Semi-supervised anomaly detection in video-surveillance scenes in the wild

  • Sarker, Mohammad Ibrahim
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Luengo Sánchez, Sara|||0000-0003-3942-3804
Surveillance cameras are being installed in many primary daily living places to maintain public safety. In this video-surveillance context, anomalies occur only for a very short time, and very occasionally. Hence, manual monitoring of such anomalies may be exhaustive and monotonous, resulting in a decrease in reliability and speed in emergency situations due to monitor tiredness. Within this framework, the importance of automatic detection of anomalies is clear, and, therefore, an important amount of research works have been made lately in this topic. According to these earlier studies, supervised approaches perform better than unsupervised ones. However, supervised approaches demand manual annotation, making dependent the system reliability of the different situations used in the training (something difficult to set in anomaly context). In this work, it is proposed an approach for anomaly detection in video-surveillance scenes based on a weakly supervised learning algorithm. Spatio-temporal features are extracted from each surveillance video using a temporal convolutional 3D neural network (T-C3D). Then, a novel ranking loss function increases the distance between the classification scores of anomalous and normal videos, reducing the number of false negatives. The proposal has been evaluated and compared against state-of-art approaches, obtaining competitive performance without fine-tuning, which also validates its generalization capability. In this paper, the proposal design and reliability is presented and analyzed, as well as the aforementioned quantitative and qualitative evaluation in-the-wild scenarios, demonstrating its high sensitivity in anomaly detection in all of them., info:eu-repo/grantAgreement/UAH//CCG2020%2FIA-043, Agencia Estatal de Investigación, Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

A multi-position approach in a smart fiber-optic surveillance system for pipeline integrity threat detection

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Martín López, Sonia|||0000-0001-5203-6206
  • González Herráez, Miguel|||0000-0003-2555-2971
We present a new pipeline integrity surveillance system for long gas pipeline threat detection and classification. The system is based on distributed acoustic sensing with phase-sensitive optical time domain reflectometry (?-OTDR) and pattern recognition for event classification. The proposal incorporates a multi-position approach in a Gaussian Mixture Model (GMM)-based pattern classification system which operates in a real-field scenario with a thorough experimental procedure. The objective is exploiting the availability of vibration-related data at positions nearby the one actually producing the main disturbance to improve the robustness of the trained models. The system integrates two classification tasks: (1) machine + activity identification, which identifies the machine that is working over the pipeline along with the activity being carried out, and (2) threat detection, which aims to detect suspicious threats for the pipeline integrity (independently of the activity being carried out). For the machine + activity identification mode, the multi-position approach for model training obtains better performance than the previously presented single-position approach for activities that show consistent behavior and high energy (between 6% and 11% absolute) with an overall increase of 3% absolute in the classification accuracy. For the threat detection mode, the proposed approach gets an 8% absolute reduction in the false alarm rate with an overall increase of 4.5% absolute in the classification accuracy., Ministerio de Economía y Competitividad, Agencia Estatal de Investigación, Universidad de Alcalá, Ministerio de Ciencia e Innovación
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Towards dense people detection with deep learning and depth images

  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Casillas Pérez, David|||0000-0002-5721-1242
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Martín López, Roberto|||0000-0002-5172-9403
  • Luna Vázquez, Carlos Andrés
This paper describes a novel DNN-based system, named PD3net, that detects multiple people from a single depth image, in real time. The proposed neural network processes a depth image and outputs a likelihood map in image coordinates, where each detection corresponds to a Gaussian-shaped local distribution, centered at each person?s head. This likelihood map encodes both the number of detected people as well as their position in the image, from which the 3D position can be computed. The proposed DNN includes spatially separated convolutions to increase performance, and runs in real-time with low budget GPUs. We use synthetic data for initially training the network, followed by fine tuning with a small amount of real data. This allows adapting the network to different scenarios without needing large and manually labeled image datasets. Due to that, the people detection system presented in this paper has numerous potential applications in different fields, such as capacity control, automatic video-surveillance, people or groups behavior analysis, healthcare or monitoring and assistance of elderly people in ambient assisted living environments. In addition, the use of depth information does not allow recognizing the identity of people in the scene, thus enabling their detection while preserving their privacy. The proposed DNN has been experimentally evaluated and compared with other state-of-the-art approaches, including both classical and DNN-based solutions, under a wide range of experimental conditions. The achieved results allows concluding that the proposed architecture and the training strategy are effective, and the network generalize to work with scenes different from those used during training. We also demonstrate that our proposal outperforms existing methods and can accurately detect people in scenes with significant occlusions., Ministerio de Economía y Competitividad, Universidad de Alcalá, Agencia Estatal de Investigación
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

People re-identification using depth and intensity information from an overhead sensor

  • Luna Vázquez, Carlos Andrés
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Mazo Quintas, Manuel Ramón
This work presents a new people re-identification method, using depth and intensity images, both of them captured with a single static camera, located in an overhead position. The proposed solution arises from the need that exists in many areas of application to carry out identification and re-identification processes to determine, for example, the time that people remain in a certain space, while fulfilling the requirement of preserving people's privacy. This work is a novelty compared to other previous solutions, since the use of top-view images of depth and intensity allows obtaining information to perform the functions of identification and re-identification of people, maintaining their privacy and reducing occlusions. In the procedure of people identification and re-identification, only three frames of intensity and depth are used, so that the first one is obtained when the person enters the scene (frontal view), the second when it is in the central area of the scene (overhead view) and the third one when it leaves the scene (back view). In the implemented method only information from the head and shoulders of people with these three different perspectives is used. From these views three feature vectors are obtained in a simple way, two of them related to depth information and the other one related to intensity data. This increases the robustness of the method against lighting changes. The proposal has been evaluated in two different datasets and compared to other state-of-the-art proposal. The obtained results show a 96,7% success rate in re-identification, with sensors that use different operating principles, all of them obtaining depth and intensity information. Furthermore, the implemented method can work in real time on a PC, without using a GPU., Ministerio de Economía y Competitividad, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

DPDnet: a robust people detector using deep learning with an overhead depth camera

  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Martín López, Roberto|||0000-0002-5172-9403
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Casillas Pérez, David|||0000-0002-5721-1242
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Luna Vázquez, Carlos Andrés
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
This paper proposes a deep learning-based method to detect multiple people from a single overhead depth image with high precision. Our neural network, called DPDnet, is composed by two fully-convolutional encoder-decoder blocks built with residual layers. The main block takes a depth image as input and generates a pixel-wise confidence map, where each detected person in the image is represented by a Gaussian-like distribution, The refinement block combines the depth image and the output from the main block, to refine the confidence map. Both blocks are simultaneously trained end-to-end using depth images and ground truth head position labels. The paper provides a rigorous experimental comparison with some of the best methods of the state-of-the-art, being exhaustively evaluated in different publicly available datasets. DPDnet proves to outperform all the evaluated methods with statistically significant differences, and with accuracies that exceed 99%. The system was trained on one of the datasets (generated by the authors and available to the scientific community) and evaluated in the others without retraining, proving also to achieve high accuracy with varying datasets and experimental conditions. Additionally, we made a comparison of our proposal with other CNN-based alternatives that have been very recently proposed in the literature, obtaining again very high performance. Finally, the computational complexity of our proposal is shown to be independent of the number of users in the scene and runs in real time using conventional GPUs., Ministerio de Economía y Competitividad, Universidad de Alcalá, Agencia Estatal de Investigación
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Fast heuristic method to detect people in frontal depth images

  • Luna Vázquez, Carlos Andrés
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Mazo Quintas, Manuel Ramón
This paper presents a new method for detecting people using only depth images captured by a camera in a frontal position. The approach is based on first detecting all the objects present in the scene and determining their average depth (distance to the camera). Next, for each object, a 3D Region of Interest (ROI) is processed around it in order to determine if the characteristics of the object correspond to the biometric characteristics of a human head. The results obtained using three public datasets captured by three depth sensors with different spatial resolutions and different operation principle (structured light, active stereo vision and Time of Flight) are presented. These results demonstrate that our method can run in realtime using a low-cost CPU platform with a high accuracy, being the processing times smaller than 1 ms per frame for a 512 × 424 image resolution with a precision of 99.26% and smaller than 4 ms per frame for a 1280 × 720 image resolution with a precision of 99.77%., Ministerio de Economía y Competitivdad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Improved perturbation detection in direct detected ϕ-OTDR systems using a novel matched filtering

  • Adeel, Muhammad
  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Lu, Chao
Nuisance Alarm Rate (NAR) is critical in ϕ-OTDR perturbation detection systems. We present in this letter a novel matched filtering-based feature extractor which aims to noise reduction so that the detection system gets improved performance. This feature extractor requires a small number of data vectors to be acquired which is combined with a random forest-based machine learning strategy to significantly reduce the NAR. In addition, since the number of data vectors is small, this system can also be useful for time-sensitive detection applications., Ministerio de Economía y Competitividad
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Towards End-to-End Acoustic Localization Using Deep Learning: From Audio Signals to Source Position Coordinates

  • Vera Díaz, Juan Manuel|||0000-0002-6152-5789
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Macías Guarasa, Javier|||0000-0002-3303-3963
This paper presents a novel approach for indoor acoustic source localization using microphone arrays, based on a Convolutional Neural Network (CNN). In the proposed solution, the CNN is designed to directly estimate the three-dimensional position of a single acoustic source using the raw audio signal as the input information and avoiding the use of hand-crafted audio features. Given the limited amount of available localization data, we propose, in this paper, a training strategy based on two steps. We first train our network using semi-synthetic data generated from close talk speech recordings. We simulate the time delays and distortion suffered in the signal that propagate from the source to the array of microphones. We then fine tune this network using a small amount of real data. Our experimental results, evaluated on a publicly available dataset recorded in a real room, show that this approach is able to produce networks that significantly improve existing localization methods based on SRP-PHAT strategies and also those presented in very recent proposals based on Convolutional Recurrent Neural Networks (CRNN). In addition, our experiments show that the performance of our CNN method does not show a relevant dependency on the speaker's gender, nor on the size of the signal window being used., Universidad de Alcalá, Ministerio de Economía, Comercio y Empresa
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Machine Learning Methods for Pipeline Surveillance Systems Based on Distributed Acoustic Sensing: A Review

  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Tejedor Noguerales, Javier
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Pastor Graells, Juan
  • Corredera Guillén, Pedro
  • Martín López, Sonia|||0000-0001-5203-6206
There is an increasing interest in researchers and companies on the combination of Distributed Acoustic Sensing (DAS) and a Pattern Recognition System (PRS) to detect and classify potentially dangerous events that occur in areas above fiber optic cables deployed along active pipelines, aiming to construct pipeline surveillance systems. This paper presents a review of the literature in what respect to machine learning techniques applied to pipeline surveillance systems based on DAS+PRS (although its scope can also be extended to any other environment in which DAS+PRS strategies are to be used). To do so, we describe the fundamentals of the machine learning approaches when applied to DAS systems, and also do a detailed literature review of the main contributions on this topic. Additionally, this paper addresses the most common issues related to real field deployment and evaluation of DAS+PRS for pipeline threat monitoring, and intends to provide useful insights and recommendations in what respect to the design of such systems. The literature review concludes that a real field deployment of a PRS based on DAS technology is still a challenging area of research, far from being fully solved., European Commission, Ministerio de Economía, Comercio y Empresa, Comunidad de Madrid
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Re-identificación de personas utilizando únicamente información de profundidad

  • Luengo Sánchez, Sara|||0000-0003-3942-3804
  • Luna Vázquez, Carlos Andrés
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Mazo Quintas, Manuel Ramón
La re-identificación de personas, entendida como el reconocimiento de un individuo observado previamente por otro sensor, es un campo que ha adquirido gran importancia en los últimos años debido a sus aplicaciones relacionadas con la videovigilancia, el control de aforos y el seguimiento de personas en entornos determinados. En este contexto, se propone un sistema que permite la re-identificación de personas a partir de imágenes de profundidad obtenidas por una red de sensores de tiempo de vuelo (ToF) ubicados en posición cenital. La información proporcionada por esos sensores permite obtener las características necesarias para re-identificar a la persona preservando su privacidad al no ser posible reconocer la identidad de los usuarios. El sistema desarrollado incluye una etapa de detección de personas, seguido de un proceso de extracción de características y atributos físicos que permiten diferenciar a un individuo de los demás mediante un proceso de clasificación, independientemente de la posición en la escena en la que se encuentre. La clasificación se realiza utilizando la técnica de análisis de las componentes principales (PCA), que permite reducir la dimensionalidad de los datos obtenidos y crear una clase diferente para cada nueva persona a re-identificar, la cual es almacenada posteriormente en el sistema. Para la evaluación de la propuesta se han realizado pruebas experimentales empleando la base de datos GOTPD1 desarrollada por los miembros del equipo investigador, que incluye múltiples personas, y ha sido adquirida utilizando dos sensores Kinect II en posición cenital., Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Label augmentation to improve generalization of deep learning semantic segmentation of laparoscopic images

  • Monasterio Expósito, Leticia
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Macías Guarasa, Javier|||0000-0002-3303-3963
Training Deep Neural Networks to solve semantic segmentation is a challenging problem with small-size labeled datasets, leading to overfitting. This is especially problematic in medical images, and in particular, in laparoscopic surgery images. In this context, ground-truth segmentation labels are available only for a small set of images with few patients. Besides, inter-patient variability is very high in practice. Models trained for a specific setup and a set of patients usually performs poorly when deployed in a new environment. This work proposes a new training strategy that improves the generalization accuracy of current state-of-the-art semantic segmentation methods applied to laparoscopic images. Our approach is based on training a discriminator network, which learns to detect segmentation errors, producing a dense segmentation error map. Unlike in adversarial networks, we train the discriminator offline by synthetically altering ground- truth segmentation labels with simple morphological and geometric operations. We then use the discriminator to train a segmentation neural network, by minimizing the discriminator predicted error jointly with a standard segmentation loss. This strategy results in segmentation models that are significantly more accurate when tested in unseen images than those only relying on data augmentation. This technique is very suitable to boost the performance of any state-of-the-art segmentation network and can be combined with other data augmentation strategies. This paper evaluates and validates our proposal by training and testing common state-of-the-art segmentation models in publicly available semantic segmentation datasets, specialized in laparoscopic and endoscopic surgery. The results show that our methods are effective, obtaining a significant improvement in terms of segmentation accuracy, especially in challenging small-size datasets., Agencia Estatal de Investigación, Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Headgear accessories classification using an overhead depth sensor

  • Luna Vázquez, Carlos Andrés
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Mazo Quintas, Manuel Ramón
  • Luengo Sánchez, Sara|||0000-0003-3942-3804
  • Macho Pedroso, Roberto
In this paper, we address the generation of semantic labels describing the headgear accessories carried out by people in a scene under surveillance, only using depth information obtained from a Time-of-Flight (ToF) camera placed in an overhead position. We propose a new method for headgear accessories classification based on the design of a robust processing strategy that includes the estimation of a meaningful feature vector that provides the relevant information about the people’s head and shoulder areas. This paper includes a detailed description of the proposed algorithmic approach, and the results obtained in tests with persons with and without headgear accessories, and with different types of hats and caps. In order to evaluate the proposal, a wide experimental validation has been carried out on a fully labeled database (that has been made available to the scientific community), including a broad variety of people and headgear accessories. For the validation, three different levels of detail have been defined, considering a different number of classes: the first level only includes two classes (hat/cap, and no hat/cap), the second one considers three classes (hat, cap and no hat/cap), and the last one includes the full class set with the five classes (no hat/cap, cap, small size hat, medium size hat, and large size hat). The achieved performance is satisfactory in every case: the average classification rates for the first level reaches 95.25%, for the second one is 92.34%, and for the full class set equals 84.60%. In addition, the online stage processing time is 5.75 ms per frame in a standard PC, thus allowing for real-time operation., Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Segregating the true perturbation position from ghost energy points region in ϕ-OTDR systems

  • Adeel, Muhammad
  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Shang, Chao
  • Lu, Chao
ϕ-OTDR perturbation detection applications demand optimal precision of the perturbation location. Strategies for improving both signal-to-noise (SNR) and precision of the perturbation location in a laboratory environment may fail when applying to a very long fiber under test (FUT) in real-field environments. With this deployment, meaningful energy points representing the response of a certain perturbation can be located at random locations of the fiber other than the original location of the perturbation. These random locations are referred to as the ghost energy points that confuse the system to mistakenly consider the location of these points as the original perturbation location. We present in this paper a novel space-time scanning (ST-scan) method that segregates the ghost energy point locations from those of the real perturbation so that the original perturbation location estimation is improved., Agencia Estatal de Investigación, Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

A realistic evaluation of indoor robot position tracking systems: the IPIN 2016 competition experience

  • Pérez Rubio, María Del Carmen|||0000-0001-8271-6843
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Espinosa Zapata, Felipe|||0000-0003-1588-0947
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Tiemann, Janis
  • Eckermann, Fabian
  • Wietfeld, Christian
  • Katkov, Maxim
  • Huba, Sergey
  • Ureña Ureña, Jesús|||0000-0003-1408-6039
  • Villadangos Carrizo, José Manuel|||0000-0001-5900-0978
  • Gualda Gómez, David|||0000-0003-2071-6260
  • Díaz Llerena, Edel
  • Nieto Capuchino, Rubén|||0000-0002-8293-9665
  • Santiso Gómez, Enrique|||0000-0002-5201-7133
  • Portillo Ortiz, Pablo Del
  • Martínez Rey, Miguel
We report a novel open competition aimed at evaluating accurate robot position tracking in indoor environments. The competition was organized within the IPIN 2016 (Indoor Positioning and Indoor Navigation international Conference). Here, we describe the competition, the competitors and their final results. The challenges of this new competition included: tracking an industrial robot following an unknown path but with a defined ground-truth, and open positioning system to be deployed on-site, with no restrictions apart from those related to safety issues. Our aim here is to provide sufficient detail to serve as a solid basis for future competition initiatives with a similar scope, using common metrics and objective evaluation procedures. In addition, the real systems evaluated represent state-of-the-art performance, and thus offer interesting solutions to the problem posed in the competition., Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Undiscovered issues and solutions for direct detected ϕ-OTDR systems

  • Adeel, Muhammad
  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Zhu, Kun
Time and spatial domains in ϕ-OTDR perturbation detection and recognition for pipeline and border security applications in very long fiber under test (FUT) environments have not been properly analyzed so far. We propose in this pa- per several issues and the corresponding solutions that should be considered in both domains when developing those applications. Solutions are based on: (1) the importance of differential signals in direct detected ϕ-OTDR systems; (2) dealing with the useless data acquired in the time domain; (3) dealing with the zero and ghost energy points along the FUT which will undoubtedly lead to hiding the real perturbation and reducing the potential of finding the exact location of the perturbation, respectively. Experimental results show that: (1) setting the appropriate experimental conditions (i.e., increasing the intensity of the perturbation and sampling at the minimum sampling rate that satisfies the Nyquist criterion) is a must; (2) the Kendall correlation-based technique on differential signals allows obtaining more significant data traces both in time and spatial domains; (3) combining both methods obtains further gains; (4) S-Scan algorithm accurately provides the time instant of the real perturbation by increasing the probability of detecting zero energy points and avoiding ghost energy points in further processing., Ministerio de Economía y Competitividad, Agencia Estatal de Investigación, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Robust people detection using depth information from an overhead time-of-flight camera

  • Luna Vázquez, Carlos Andrés
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Fuentes Jiménez, David|||0000-0001-6424-4782
  • Fernández Rincón, Álvaro
  • Mazo Quintas, Manuel Ramón
  • Macías Guarasa, Javier|||0000-0002-3303-3963
In this paper we describe a system for the automatic detection of multiple people in a scene, by only using depth information provided by a Time of Flight (ToF) camera placed in overhead position. The main contribution of this work lies in the proposal of a methodology for determining the Regions of Interest (ROI’s) and feature extraction, which result in a robust discrimination between people with or without accessories and objects (either static or dynamic), even when people and objects are close together. Since only depth information is used, the developed system guarantees users’ privacy. The designed algorithm includes two stages: an online stage, and an offline one. In the offline stage, a new depth image dataset has been recorded and labeled, and the labeled images have been used to train a classifier. The online stage is based on robustly detecting local maximums in the depth image (which are candidates to correspond to the head of the people present in the scene), from which a carefully ROI is defined around each of them. For each ROI, a feature vector is extracted, providing information on the top view of people and objects, including information related to the expected overhead morphology of the head and shoulders. The online stage also includes a pre-filtering process, in order to reduce noise in the depth images. Finally, there is a classification process based on Principal Components Analysis (PCA). The online stage works in real time at an average of 150 fps. In order to evaluate the proposal, a wide experimental validation has been carried out, including different number of people simultaneously present in the scene, as well as people with different heights, complexions, and accessories. The obtained results are very satisfactory, with a 3.1% average error rate., Ministerio de Economía y Competitividad, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Real field deployment of a smart fiber optic surveillance system for pipeline integrity threat detection: architectural issues and blind field test results

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Pastor Graells, Juan
  • Martín López, Sonia|||0000-0001-5203-6206
  • Corredera Guillén, Pedro
  • De Pauw, G.
  • De Smet, F.
  • Postvoll, W.
  • Ahlen, C.H.
  • González Herráez, Miguel|||0000-0003-2555-2971
This paper presents an on-line augmented surveillance system that aims to real time monitoring of activities along a pipeline. The system is deployed in a fully realistic scenario and exposed to real activities carried out in unknown places at unknown times within a given test time interval (socalled blind field tests). We describe the system architecture that includes specific modules to deal with the fact that continuous on-line monitoring needs to be carried out, while addressing the need of limiting the false alarms at reasonable rates. To the best or our knowledge, this is the first published work in which a pipeline integrity threat detection system is deployed in a realistic scenario (using a fiber optic along an active gas pipeline) and is thoroughly and objectively evaluated in realistic blind conditions. The system integrates two operation modes: The machine+activity identification mode identifies the machine that is carrying out a certain activity along the pipeline, and the threat detection mode directly identifies if the activity along the pipeline is a threat or not. The blind field tests are carried out in two different pipeline sections: The first section corresponds to the case where the sensor is close to the sensed area, while the second one places the sensed area about 35 km far from the sensor. Results of the machine+activity identification mode showed an average machine+activity classification rate of 46:6%. For the threat detection mode, 8 out of 10 threats were correctly detected, with only 1 false alarm appearing in a 55:5-hour sensed period., European Commission, Ministerio de Economía y Competitividad, Comunidad de Madrid
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Contribución de congreso (ConferenceOutput)

A novel fiber optic based surveillance system for prevention of pipeline integrity threats

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Piote, D.
  • Pastor Graells, Juan
  • Martín López, Sonia|||0000-0001-5203-6206
  • Corredera Guillén, Pedro
  • González Herráez, Miguel|||0000-0003-2555-2971
This paper presents a novel surveillance system aimed at the detection and classification of threats in the vicinity of a long gas pipeline. The sensing system is based on phase-sensitive optical time domain reflectometry (φ-OTDR) technology for signal acquisition and pattern recognition strategies for threat identification. The proposal incorporates contextual information at the feature level and applies a system combination strategy for pattern classification. The contextual information at the feature level is based on the tandem approach (using feature representations produced by discriminatively-trained multi-layer perceptrons) by employing feature vectors that spread different temporal contexts. The system combination strategy is based on a posterior combination of likelihoods computed from different pattern classification processes. The system operates in two different modes: (1) machine + activity identification, which recognizes the activity being carried out by a certain machine, and (2) threat detection, aimed at detecting threats no matter what the real activity being conducted is. In comparison with a previous system based on the same rigorous experimental setup, the results show that the system combination from the contextual feature information improves the results for each individual class in both operational modes, as well as the overall classification accuracy, with statistically-significant improvements., European Commission, Ministerio de Economía y Competitividad, Comunidad de Madrid
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Contribución de congreso (ConferenceOutput)

A Gaussian Mixture Model-Hidden Markov Model (GMM-HMM)-based fiber optic surveillance system for pipeline integrity threat detection

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Martín López, Sonia|||0000-0001-5203-6206
  • González Herráez, Miguel|||0000-0003-2555-2971
26th International Conference on Optical Fiber Sensors OFS-26, 24/09/2018-28/09/2018, Lausanne, Suiza., A pipeline integrity threat detection system using Distributed Acoustic Sensing and Artificial Intelligence (AI) is presented. The AI uses a combination of Gaussian Mixture Models and Hidden Markov Models (GMMs-HMMs), outperforming our former GMM-based system., European Commission, Ministerio de Economía y Competitividad, Comunidad de Madrid, Universidad de Alcalá
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

A Contextual GMM-HMM Smart Fiber Optic Surveillance System for Pipeline Integrity Threat Detection

  • Tejedor Noguerales, Javier
  • Macías Guarasa, Javier|||0000-0002-3303-3963
  • Fidalgo Martins, Hugo|||0000-0003-3927-8125
  • Martín López, Sonia|||0000-0001-5203-6206
  • González Herráez, Miguel|||0000-0003-2555-2971
This paper presents a novel pipeline integrity surveillance system aimed to the detection and classification of threats in the vicinity of a long gas pipeline. The sensing system is based on phase-sensitive optical time domain reflectometry ( $\phi$ -OTDR) technology for signal acquisition and pattern recognition strategies for threat identification. The proposal incorporates contextual information at the feature level in a Gaussian Mixture Model-Hidden Markov Model (GMM-HMM)-based pattern classification system and applies a system combination strategy for acoustic trace decision. System combination relies on majority voting of the decisions given by the individual contextual information sources and the number of states used for HMM modelling. The system runs in two different modes: (1) machine+activity identification, which recognizes the activity being carried out by a certain machine, and (2) threat detection, aimed to detect threats no matter what the real activity being conducted is. In comparison with the previous systems based on the same rigorous experimental setup, the results show that the system combination from the contextual feature information and the GMM-HMM approach improves the results for both machine+activity identification (7.6% of relative improvement with respect to the best published result in the literature on this task) and threat detection (26.6% of relative improvement in the false alarm rate with 2.1% relative reduction in the threat detection rate)., European Commission, Ministerio de Economía y Competitividad, Comunidad de Madrid
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Smart video surveillance system based on edge computing

  • Cob Parro, Antonio Carlos
  • Losada Gutiérrez, Cristina|||0000-0001-9545-327X
  • Marrón Romera, Marta|||0000-0001-7723-2262
  • Gardel Vicente, Alfredo|||0000-0001-7887-4689
  • Bravo Muñoz, Ignacio|||0000-0002-6964-0036
New processing methods based on artificial intelligence (AI) and deep learning are replacing traditional computer vision algorithms. The more advanced systems can process huge amounts of data in large computing facilities. In contrast, this paper presents a smart video surveillance system executing AI algorithms in low power consumption embedded devices. The computer vision algorithm, typical for surveillance applications, aims to detect, count and track people?s movements in the area. This application requires a distributed smart camera system. The proposed AI application allows detecting people in the surveillance area using a MobileNet-SSD architecture. In addition, using a robust Kalman filter bank, the algorithm can keep track of people in the video also providing people counting information. The detection results are excellent considering the constraints imposed on the process. The selected architecture for the edge node is based on a UpSquared2 device that includes a vision processor unit (VPU) capable of accelerating the AI CNN inference. The results section provides information about the image processing time when multiple video cameras are connected to the same edge node, people detection precision and recall curves, and the energy consumption of the system. The discussion of results shows the usefulness of deploying this smart camera node throughout a distributed surveillance system. ;, European Commission, Ministerio de Economía y Competitividad
e_Buah Biblioteca Digital Universidad de Alcalá
Publication Artículo científico (JournalArticle)

Acoustic source localization with deep generalized cross correlations

  • Vera Díaz, Juan Manuel|||0000-0002-6152-5789
  • Pizarro Pérez, Daniel|||0000-0003-0622-4884
  • Macías Guarasa, Javier|||0000-0002-3303-3963
One of the most popular techniques for Acoustic Source Localization is the Generalized Cross Correlation (GCC) and its use in Steered Response Power techniques (SRP). Nowadays, Deep Learning strategies may outperform these classical methods, but they are generally dependent on the room and sensor geometric configuration that are used during the training phases. Hence, they require adaptation and re-training when facing a new environment, which is a problem in practice as re-training requires labelling new data and running a complex training algorithm. In this work we use a Convolutional Deep Neural Network that transforms the GCC between two signals into a Gaussian shaped signal, that we call Deep Generalized Cross Correlation (DeepGCC). We combine DeepGCC estimations to create a 3D acoustic map, similarly to SRP techniques. This acoustic map can be further refined using a sparse generative model to recover the source position. Crucially, we can adapt the acoustic map to different microphone array geometries without retraining the DeepGCC network. We show that our method outperforms both classical approaches and recent Deep Learning strategies in real and simulated challenging scenarios with mismatched training-testing conditions, not requiring re-training with different sensor configurations or room environments., Ministerio de Economía y Competitividad, Agencia Estatal de Investigación, Universidad de Alcalá