Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 18
Encontrada(s) 1 página(s)

Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Cancelable face biometrics with soft-biometric privacy enhancement

  • Melzi, Pietro
  • Otroshi Shahreza, Hatef
  • Rathgeb, Christian
  • Vera Rodríguez, Rubén
  • Fiérrez Aguilar, Julián
  • Marcel, Sébastien
  • Busch, Christoph
  • Tolosana Moranchel, Rubén
The storage of biometric data has raised significant privacy concerns, necessitating robust measures for secure storage. While traditional Privacy-Enhancing Technologies (PETs), like Cancelable Biometric (CB) schemes, excel at creating protected templates that fulfill criteria such as irreversibility and unlinkability, they often fail to preserve the privacy of soft-biometric information. To address this issue, we propose a hybrid technology that combines PETs, leveraging their different properties to comprehensively address multiple privacy requirements and enhance overall protection for biometric templates. In our approach, we integrate Multi Incremental Variable Elimination (Multi-IVE), a recent technology designed to remove soft-biometric information from biometric templates, with conventional CB schemes. We apply our hybrid technology to facial templates and assess the properties of the resulting protected templates. In the event of stolen secrets, the combination of Multi-IVE with CB schemes helps decrease the accuracy of estimating soft-biometric attributes without affecting recognition performance, compared to CB schemes alone, This work was supported in part by European Union’s Horizon 2020 Research and Innovation Program under the Marie Skłodowska-Curie under Grant 860813—TReSPAsS-ETN; and in part by German Federal Ministry of Education and Research and the Hessian Ministry of Higher Education, Research, Science and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE. The work of Rubén Tolosana and Ruben Vera-Rodríguez was supported by INTERACTION under Grant PID2021-126521OB-I00 MICINN/FEDER. The work of Julián Fiérrez was supported by BBforTAI under Grant PID2021-127641OB-I00 MICINN/FEDER. UAM members are also supported by Cátedra ENIA UAM-VERIDAS en IA Responsable (NextGenerationEU PRTR TSI-100927-2023-2)
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

SVC-onGoing: Signature verification competition

  • Vera Rodríguez, Rubén
  • Fiérrez Aguilar, Julián
  • Morales Moreno, Aythami
  • Ortega García, Javier
  • Tolosana Moranchel, Rubén
  • Gonzalez-Garcia, Carlos
  • Carlos Ruiz-Garcia, Juan
  • Romero Tapiador, Sergio
  • Rengifo, Santiago
  • Caruana, Miguel
  • Jiang, Jiajia
  • Lai, Songxuan
  • Jin, Lianwen
  • Zhu, Yecheng
  • Galbally, Javier
  • Diaz, Moises
  • Angel Ferrer, Miguel
  • Gomez-Barrero, Marta
  • Hodashinsky, Ilya
  • Sarin, Konstantin
  • Slezkin, Artem
  • Bardamova, Marina
  • Svetlakov, Mikhail
  • Saleem, Mohammad
  • Lia Szcs, Cintia
  • Kovari, Bence
  • Pulsmeyer, Falk
  • Wehbi, Mohamad
  • Zanca, Dario
  • Ahmad, Sumaiya
  • Mishra, Sarthak
  • Jabin, Suraiya
This article presents SVC-onGoing1, an on-going competition for on-line signature verification where researchers can easily benchmark their systems against the state of the art in an open common platform using large-scale public databases, such as DeepSignDB2 and SVC2021_EvalDB3, and standard experimental protocols. SVC-onGoing is based on the ICDAR 2021 Competition on On-Line Signature Verification (SVC 2021), which has been extended to allow participants anytime. The goal of SVC-onGoing is to evaluate the limits of on-line signature verification systems on popular scenarios (office/mobile) and writing inputs (stylus/finger) through large-scale public databases. Three different tasks are considered in the competition, simulating realistic scenarios as both random and skilled forgeries are simultaneously considered on each task. The results obtained in SVC-onGoing prove the high potential of deep learning methods in comparison with traditional methods. In particular, the best signature verification system has obtained Equal Error Rate (EER) values of 3.33% (Task 1), 7.41% (Task 2), and 6.04% (Task 3). Future studies in the field should be oriented to improve the performance of signature verification systems on the challenging mobile scenarios of SVC-onGoing in which several mobile devices and the finger are used during the signature acquisition, This work has been supported by projects: PRIMA (H2020- MSCA-ITN-2019-860315), TRESPASS-ETN (H2020-MSCA-ITN-2019- 860813), INTER-ACTION (PID2021-126521OB-I00 MICINN/FEDER), Orange Labs, and by UAM-Cecabank
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

SensitiveNets: Learning agnostic representations with application to face images

  • Morales Moreno, Aythami
  • Fiérrez Aguilar, Julián
  • Vera Rodríguez, Rubén
  • Tolosana Moranchel, Rubén
© 2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, This work proposes a novel privacy-preserving neural network feature representation to suppress the sensitive information of a learned space while maintaining the utility of the data. The new international regulation for personal data protection forces data controllers to guarantee privacy and avoid discriminative hazards while managing sensitive data of users. In our approach, privacy and discrimination are related to each other. Instead of existing approaches aimed directly at fairness improvement, the proposed feature representation enforces the privacy of selected attributes. This way fairness is not the objective, but the result of a privacy-preserving learning method. This approach guarantees that sensitive information cannot be exploited by any agent who process the output of the model, ensuring both privacy and equality of opportunity. Our method is based on an adversarial regularizer that introduces a sensitive information removal function in the learning objective. The method is evaluated on three different primary tasks (identity, attractiveness, and smiling) and three publicly available benchmarks. In addition, we present a new face annotation dataset with balanced distribution between genders and ethnic origins. The experiments demonstrate that it is possible to improve the privacy and equality of opportunity while retaining competitive performance independently of the task, This work was supported by projects: PRIMA (MSCA-ITN-2019-860315), TRESPASS-ETN (MSCA-ITN-2019-860813), and BIBECA (RTI2018-101248-B-I00 MINECO)
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

OTB-morph: one-time biometrics via morphing

  • Ghafourian, Mahdi
  • Fiérrez Aguilar, Julián
  • Vera Rodríguez, Rubén
  • Morales Moreno, Aythami
  • Serna Cabello, José Ignacio de la
Cancelable biometrics are a group of techniques to transform the input biometric to an irreversible feature intentionally using a transformation function and usually a key in order to provide security and privacy in biometric recognition systems. This transformation is repeatable enabling subsequent biometric comparisons. This paper introduces a new idea to be exploited as a transformation function for cancelable biometrics aimed at protecting templates against iterative optimization attacks. Our proposed scheme is based on time-varying keys (random biometrics in our case) and morphing transformations. An experimental implementation of the proposed scheme is given for face biometrics. The results confirm that the proposed approach is able to withstand leakage attacks while improving the recognition performance, This work has been supported by projects: PRIMA (H2020-MSCA-ITN-2019- 860315), TRESPASS-ETN (H2020-MSCA-ITN-2019-860813), and BBforTAI (PID2021-127641OB-I00 MICINN/FEDER). M.G. is supported by PRIMA and I.S. is supported by an FPI fellowship from Univ. Autonoma de Madrid
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

SetMargin loss applied to deep keystroke biometrics with circle packing interpretation

  • Morales Moreno, Aythami
  • Fiérrez Aguilar, Julián
  • Acién Ayala, Alejandro
  • Serna Cabello, José Ignacio de la
  • Tolosana Moranchel, Rubén
This work presents a new deep learning approach for keystroke biometrics based on a novel Distance Metric Learning method (DML). DML maps input data into a learned representation space that reveals a “semantic” structure based on distances. In this work, we propose a novel DML method specifically designed to address the challenges associated to free-text keystroke identification where the classes used in learning and inference are disjoint. The proposed SetMargin Loss (SM-L) extends traditional DML approaches with a learning process guided by pairs of sets instead of pairs of samples, as done traditionally. The proposed learning strategy allows to enlarge inter-class distances while maintaining the intra-class structure of keystroke dynamics. We analyze the resulting representation space using the mathematical problem known as Circle Packing, which provides neighbourhood structures with a theoretical maximum inter-class distance. We finally prove experimentally the effectiveness of the proposed approach on a challenging task: keystroke biometric identification over a large set of 78,000 subjects. Our method achieves state-of-the-art accuracy on a comparison performed with the best existing approaches, This work has been supported by projects: PRIMA ( MSCA-ITN- 2019-860315 ), TRESPASS-ETN (MSCA-ITN-2019-860813), BIBECA (RTI2018-101248-B-I00 MINECO), edBB (UAM), and Instituto de In- genieria del Conocimiento (IIC). A. Acien is supported by a FPI fel- lowship from the Spanish MINECO
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Face image quality assessment: a literature survey

  • Schlett, Torsten
  • Rathgeb, Christian
  • Henninger, Olaf
  • Busch, Christoph
  • Galbally, Javier
  • Fiérrez Aguilar, Julián
The performance of face analysis and recognition systems depends on the quality of the acquired face data, which is influenced by numerous factors. Automatically assessing the quality of face data in terms of biometric utility can thus be useful to detect low-quality data and make decisions accordingly. This survey provides an overview of the face image quality assessment literature, which predominantly focuses on visible wavelength face image input. A trend towards deep learning-based methods is observed, including notable conceptual differences among the recent approaches, such as the integration of quality assessment into face recognition models. Besides image selection, face image quality assessment can also be used in a variety of other application scenarios, which are discussed herein. Open issues and challenges are pointed out, i.a., highlighting the importance of comparability for algorithm evaluations and the challenge for future work to create deep learning approaches that are interpretable in addition to providing accurate utility predictions, This research work has been funded by the German Federal Ministry of Education and Research and the Hessen State Ministry for Higher Education, Research and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE, project BIBECA (RTI2018-101248-B-I00 MINECO/FEDER), and project TReSPAsS-ETN (H2020- MSCA-ITN-2019-860813). This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 883356. This text reflects only the authors’ views and the Commission is not liable for any use that may be made of the information contained therein
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

GANprintR: Improved Fakes and Evaluation of the State of the Art in Face Manipulation Detection

  • Neves, João C.
  • Lopes, Vasco
  • Vera Rodríguez, Rubén
  • Fiérrez Aguilar, Julián
  • Tolosana Moranchel, Rubén
  • Proença, Hugo
© 2020 IEEE.  Personal use of this material is permitted.  Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, The availability of large-scale facial databases, together with the remarkable progresses of deep learning technologies, in particular Generative Adversarial Networks (GANs), have led to the generation of extremely realistic fake facial content, raising obvious concerns about the potential for misuse. Such concerns have fostered the research on manipulation detection methods that, contrary to humans, have already achieved astonishing results in various scenarios. In this study, we focus on the synthesis of entire facial images, which is a specific type of facial manipulation. The main contributions of this study are four-fold: i) a novel strategy to remove GAN 'fingerprints' from synthetic fake images based on autoencoders is described, in order to spoof facial manipulation detection systems while keeping the visual quality of the resulting images; ii) an in-depth analysis of the recent literature in facial manipulation detection; iii) a complete experimental assessment of this type of facial manipulation, considering the state-of-the-art fake detection systems (based on holistic deep networks, steganalysis, and local artifacts), remarking how challenging is this task in unconstrained scenarios; and finally iv) we announce a novel public database, named iFakeFaceDB, yielding from the application of our proposed GAN-fingerprint Removal approach (GANprintR) to already very realistic synthetic fake images. The results obtained in our empirical evaluation show that additional efforts are required to develop robust facial manipulation detection systems against unseen conditions and spoof techniques, such as the one proposed in this study, This work has been supported by projects: PRIMA (H2020-MSCA-ITN-2019-860315), TRESPASS-ETN (H2020-MSCA-ITN2019-860813), BIBECA (RTI2018-101248-B-I00 MINECO/FEDER), BioGuard (Ayudas Fundación BBVA a Equipos de Investigación Cientíifica 2017), Accenture, by NOVA LINCS (UIDB/04516/2020) with the financial support of FCT - Fundação para a Ciência e a Tecnologia, through national funds, and by FCT/MCTES through national funds and co-funded by EU under the project UIDB/EEA/50008/2020
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Sensitive loss: Improving accuracy and fairness of face representations with discrimination-aware deep learning

  • Serna Cabello, José Ignacio de la
  • Morales Moreno, Aythami
  • Fiérrez Aguilar, Julián
  • Obradovich, Nick
We propose a discrimination-aware learning method to improve both the accuracy and fairness of biased face recognition algorithms. The most popular face recognition benchmarks assume a distribution of subjects without paying much attention to their demographic attributes. In this work, we perform a comprehensive discrimination-aware experimentation of deep learning-based face recognition. We also propose a notational framework for algorithmic discrimination with application to face biometrics. The experiments include three popular face recognition models and three public databases composed of 64,000 identities from different demographic groups characterized by sex and ethnicity. We experimentally show that learning processes based on the most used face databases have led to popular pre-trained deep face models that present evidence of strong algorithmic discrimination. Finally, we propose a discrimination-aware learning method, Sensitive Loss, based on the popular triplet loss function and a sensitive triplet generator. Our approach works as an add-on to pre-trained networks and is used to improve their performance in terms of average accuracy and fairness. The method shows results comparable to state-of-the-art de-biasing networks and represents a step forward to prevent discriminatory automatic systems., This work has been supported by projects: TRESPASS-ETN (MSCA-ITN-2019-860813), PRIMA (MSCA-ITN-2019-860315), BIBECA (RTI2018-101248-B-I00 MINECO/FEDER), and BBforTAI (PID2021-127641OB-I00 MICINN/FEDER). I. Serna is supported by a research fellowship from the Universidad Autónoma de Madrid (FPI-UAM-2020). A. Morales is supported by the Madrid Government (Comunidad de Madrid-Spain) under the Multiannual Agreement with Autonomous University of Madrid in the line Encouragement of the Research of Young Researchers, in the context of the V PRICIT (Regional Programme of Research and Technological Innovation)
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Deepfakes and beyond: A Survey of face manipulation and fake detection

  • Vera Rodríguez, Rubén
  • Fiérrez Aguilar, Julián
  • Morales Moreno, Aythami
  • Ortega García, Javier
  • Tolosana Moranchel, Rubén
The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding implications towards society in this era of fake news. This survey provides a thorough review of techniques for manipulating face images including DeepFake methods, and methods to detect such manipulations. In particular, four types of facial manipulation are reviewed: i) entire face synthesis, ii) identity swap (DeepFakes), iii) attribute manipulation, and iv) expression swap. For each manipulation group, we provide details regarding manipulation techniques, existing public databases, and key benchmarks for technology evaluation of fake detection methods, including a summary of results from those evaluations. Among all the aspects discussed in the survey, we pay special attention to the latest generation of DeepFakes, highlighting its improvements and challenges for fake detection. In addition to the survey information, we also discuss open issues and future trends that should be considered to advance in the field, This work has been supported by projects: PRIMA (H2020-MSCAITN-2019-860315), TRESPASS-ETN (H2020-MSCA-ITN-2019-860813), BIBECA (MINECO/FEDER RTI2018-101248-B-I00), Bio-Guard (Ayudas Fundación BBVA a Equipos de Investigación Científica 2017), and Accenture. Ruben Tolosana is supported by Consejería de Educación, Juventud y Deporte de la Comunidad de Madrid y Fondo Social Europeo
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

DeepSign: Deep On-Line Signature Verification

  • Vera Rodríguez, Rubén
  • Fiérrez Aguilar, Julián
  • Ortega García, Javier
  • Tolosana Moranchel, Rubén
Deep learning has become a breathtaking technology in the last years, overcoming traditional handcrafted approaches and even humans for many different tasks. However, in some tasks, such as the verification of handwritten signatures, the amount of publicly available data is scarce, what makes difficult to test the real limits of deep learning. In addition to the lack of public data, it is not easy to evaluate the improvements of novel proposed approaches as different databases and experimental protocols are usually considered. The main contributions of this study are: i) we provide an in-depth analysis of state-of-the-art deep learning approaches for on-line signature verification, ii) we present and describe the new DeepSignDB on-line handwritten signature biometric public database,1 iii) we propose a standard experimental protocol and benchmark to be used for the research community in order to perform a fair comparison of novel approaches with the state of the art, and iv) we adapt and evaluate our recent deep learning approach named Time-Aligned Recurrent Neural Networks (TA-RNNs)2. for the task of on-line handwritten signature verification. This approach combines the potential of Dynamic Time Warping and Recurrent Neural Networks to train more robust systems against forgeries. Our proposed TA-RNN system outperforms the state of the art, achieving results even below 2.0% EER when considering skilled forgery impostors and just one training signature per user.1https://github.com/BiDAlab/DeepSignDB 2Spanish Patent Application (P202030060), This work was supported in part by PRIMA under Grant H2020-MSCA-ITN-2019-860315; in part by TRESPASS-ETN under Grant H2020-MSCA-ITN-2019-860813; in part by BIBECA under Grant RTI2018-101248-B-I00 MINECO/FEDER; in part by Bio-Guard (Ayudas Fundación BBVA a Equipos de Investigación Científica 2017); and in part by UAM-Cecabank. The work of Ruben Tolosana was supported by the Comunidad de Madrid and Fondo Social Europeo. Spanish Patent Application (P202030060)
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

DeepFakes detection across generations: Analysis of facial regions, fusion, and performance evaluation

  • Romero Tapiador, Sergio
  • Gonzalez Sosa
  • Vera Rodríguez, Rubén
  • Fiérrez Aguilar, Julián
  • Tolosana Moranchel, Rubén
Media forensics has attracted a tremendous attention in the last years in part due to the increasing concerns around DeepFakes. Since the release of the initial DeepFakes databases of the 1st generation such as UADFV and FaceForensics++ up to the latest databases of the 2nd generation such as Celeb-DF and DFDC, many visual improvements have been carried out, making fake videos almost indistinguishable to the human eye. This study provides an in-depth analysis of both 1st and 2nd DeepFakes generations in terms of fake detection performance. Two different methods are considered in our experimental framework: (i) the traditional one followed in the literature based on selecting the entire face as input to the fake detection system, and (ii) a novel approach based on the selection of specific facial regions as input to the fake detection system. Fusion techniques are applied both to the facial regions and also to three different state-of-the-art fake detection systems (Xception, Capsule Network, and DSP-FWA) in order to further increase the robustness of the detectors considered. Finally, experiments regarding intra- and inter-database scenarios are performed. Among all the findings resulting from our experiments, we highlight: (i) the very good results achieved using facial regions and fusion techniques with fake detection results above 99% Area Under the Curve (AUC) for UADFV, FaceForensics++, and Celeb-DF v2 databases, and (ii) the necessity to put more efforts on the analysis of inter-database scenarios to improve the ability of the fake detectors against attacks unseen during learning, This work has been supported by projects: PRIMA (H2020-MSCAITN-2019-860315), TRESPASS-ETN (H2020-MSCA-ITN-2019-860813), BIBECA, Spain (MINECO/FEDER RTI2018-101248-B-I00)
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

IRL-Net: inpainted region localization network via spatial attention

  • Daryani, Amir Etefaghi
  • Mirmahdi, Mahdieh
  • Hassanpour, Ahmad
  • Shahreza, Hatef Otroshi
  • Yang, Bian
  • Fiérrez Aguilar, Julián
Identifying manipulated regions in images is a challenging task due to the existence of very accurate image inpainting techniques leaving almost unnoticeable traces in tampered regions. These image inpainting methods can be used for multiple purposes (e.g., removing objects, reconstructing corrupted areas, eliminating various types of distortion, etc.) makes creating forensic detectors for image manipulation an extremely difficult and time-consuming procedure. The aim of this paper is to localize the tampered regions manipulated by image inpainting methods. To do this, we propose a novel CNN-based deep learning model called IRL-Net which includes three main modules: Enhancement, Encoder, and Decoder modules. To evaluate our method, three image inpainting methods have been used to reconstruct the missed regions in two face and scene image datasets. We perform both qualitative and quantitative evaluations on the generated datasets. Experimental results demonstrate that our method outperforms previous learning-based manipulated region detection methods and generates realistic and semantically plausible images. We also provide the implementation of the proposed approach to support reproducible research via https://github.com/amiretefaghi/IRL-Net, This work was supported by the Project Privacy Matters (PRIMA) under Grant H2020-MSCA-ITN-2019-860315. The work of Hatef Otroshi Shahreza was supported by the H2020 TReSPAsS-ETN Marie Skłodowska-Curie Early Training Network under Grant 860813. The work of Julian Fierrez was supported by the Project Biometrics and Behavior for Unbiased and Trusted AI with Applications (BBforTAI) under Grant PID2021-127641OB-I00 MICINN/FEDER
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Symbolic AI for XAI: Evaluating LFIT inductive programming for explaining biases in machine learning

  • Ortega de la Puente, Alfonso
  • Wang, Zilong
  • de la Cruz, Marina
  • Alonso, César Luis
  • Ribeiro, Tony
  • Fiérrez Aguilar, Julián
  • Morales Moreno, Aythami
Machine learning methods are growing in relevance for biometrics and personal information processing in domains such as forensics, e-health, recruitment, and e-learning. In these domains, white-box (human-readable) explanations of systems built on machine learning methods become crucial. Inductive logic programming (ILP) is a subfield of symbolic AI aimed to automatically learn declarative theories about the processing of data. Learning from interpretation transition (LFIT) is an ILP technique that can learn a propositional logic theory equivalent to a given black-box system (under certain conditions). The present work takes a first step to a general methodology to incorporate accurate declarative explanations to classic machine learning by checking the viability of LFIT in a specific AI application scenario: fair recruitment based on an automatic tool generated with machine learning methods for ranking Curricula Vitae that incorporates soft biometric information (gender and ethnicity). We show the expressiveness of LFIT for this specific problem and propose a scheme that can be applicable to other domains. In order to check the ability to cope with other domains no matter the machine learning paradigm used, we have done a preliminary test of the expressiveness of LFIT, feeding it with a real dataset about adult incomes taken from the US census, in which we consider the income level as a function of the rest of attributes to verify if LFIT can provide logical theory to support and explain to what extent higher incomes are biased by gender and ethnicity, This work was supported by projects: PRIMA (H2020-MSCA-ITN-2019-860315), TRESPASS-ETN(H2020-MSCA-ITN-2019-860813), IDEA-FAST (IMI2-2018-15-853981), BIBECA(RTI2018-101248-B-I00MINECO/FEDER), RTI2018-095232-B-C22MINECO, PLeNTaS project PID2019-111430RBI00MINECO; and also by Pays de la Loire Region through RFI Atlanstic 2020
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Spatio-temporal trajectory data modeling for fishing gear classification

  • Rodriguez‑Albala, Juan Manuel
  • Peña Almansa, Alejandro
  • Melzi, Pietro
  • Morales Moreno, Aythami
  • Fiérrez Aguilar, Julián
  • Vera Rodríguez, Rubén
  • Ortega García, Javier
  • Tolosana Moranchel, Rubén
International Organizations urge the protection of our oceans and their ecosystems due to their immeasurable importance to humankind. Since illegal fshing activities, commonly known as IUU fshing, cause irreparable damage to these ecosystems, concerned organisms are pushing to detect and combat IUU fshing practices. The automatic identifcation system allows to locate the position and trajectory of fshing vessels. In this study we address the task of detecting vessels’ fshing gears based on the trajectory behavior defned by GPS position data, a useful task to prevent the proliferation of IUU fshing practices. We present a new database including trajectories that span 7 diferent fshing gears and analyze these as in a time sequence analysis problem. We leverage from feature extraction techniques from the online signature verifcation domain to model vessel trajectories, and extract relevant information in the form of both local and global feature sets. We show how, based on these sets of features, the kinematics of vessels according to diferent fshing gears can be efectively classifed using common supervised learning algorithms with accuracies up to 90%. Furthermore, motivated by the concerns raised by several organizations on the adverse impact of bottom trawling on marine biodiversity, we present a binary classifcation experiment in which we were able to distinguish this kind of fshing gear with an accuracy of 99%. We also illustrate in an ablation study the relevance of factors such as data availability and the sampling period to perform fshing gear classifcation. Compared to existing works, we highlight these factors, especially the importance of using sampling periods in the order of minutes instead of hours, This work has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 860813-TReSPAsS-ETN. This study is also supported by the project INTER-ACTION (PID2021- 126521OB-I00 MICINN/FEDER)
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

BeCAPTCHA: Behavioral bot detection using touchscreen and mobile sensors benchmarked on HuMIdb

  • Acién Ayala, Alejandro
  • Morales Moreno, Aythami
  • Fiérrez Aguilar, Julián
  • Vera Rodríguez, Rubén
  • Delgado Ben Mohatar, Óscar
In this paper we study the suitability of a new generation of CAPTCHA methods based on smartphone interactions. The heterogeneous flow of data generated during the interaction with the smartphones can be used to model human behavior when interacting with the technology and improve bot detection algorithms. For this, we propose BeCAPTCHA, a CAPTCHA method based on the analysis of the touchscreen information obtained during a single drag and drop task in combination with the accelerometer data. The goal of BeCAPTCHA is to determine whether the drag and drop task was realized by a human or a bot. We evaluate the method by generating fake samples synthesized with Generative Adversarial Neural Networks and handcrafted methods. Our results suggest the potential of mobile sensors to characterize the human behavior and develop a new generation of CAPTCHAs. The experiments are evaluated with HuMIdb1 (Human Mobile Interaction database), a novel multimodal mobile database that comprises 14 mobile sensors acquired from 600 users. HuMIdb is freely available to the research community, This work has been supported by projects: PRIMA, Spain (H2020-MSCA-ITN-2019-860315), TRESPASS-ETN, Spain (H2020-MSCA-ITN-2019-860813), BIBECA RTI2018-101248-B-I00 (MINECO/FEDER), and BioGuard, Spain (Ayudas Fundación BBVA a Equipos de Investigación Científica 2017). Spanish Patent Application P202030066
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

An overview of privacy-enhancing technologies in biometric recognition

  • Melzi, Pietro
  • Rathgeb, Christian
  • Busch, Christoph
  • Tolosana Moranchel, Rubén
Privacy-enhancing technologies are technologies that implement fundamental data protection principles. With respect to biometric recognition, different types of privacy-enhancing technologies have been introduced for protecting stored biometric data, which are generally classified as sensitive. In this regard, various taxonomies and conceptual categorizations have been proposed and standardisation activities have been carried out. However, these efforts have mainly been devoted to certain sub-categories of privacy-enhancing technologies and therefore lack generalization. This work provides an overview of concepts of privacy-enhancing technologies for biometric recognition in a unified framework. Key properties and differences between existing concepts are highlighted in detail at each processing step. Fundamental characteristics and limitations of existing technologies are discussed and related to data protection techniques and principles. Moreover, scenarios and methods for the assessment of privacy-enhancing technologies for biometric recognition are presented. This article is meant as a point of entry to the field of data protection for biometric recognition applications and is directed toward experienced researchers as well as non-experts, This work has in part received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 860813 - TReSPAsS-ETN and the German Federal Ministry of Education and Research and the Hessen State Ministry for Higher Education, Research and the Arts within their joint support of the National Research Center for Applied Cybersecurity ATHENE. R. Tolosana and R. Vera-Rodriguez are also supported by INTER-ACTION (PID2021-126521OB-I00 MICINN/FEDER) and Cátedra ENIA UAM-VERIDAS en IA Responsable (NextGenerationEU PRTR
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

Prediction of atrial fibrillation from sinus-rhythm electrocardiograms based on deep neural networks: Analysis of time intervals and longitudinal study

  • Melzi, Pietro
  • Vera Rodríguez, Rubén
  • Sanz-García, Ancor
  • Cecconi, Alberto
  • Ortega, Guillermo J.
  • Jiménez-Borreguero, Luis Jesús
  • Tolosana Moranchel, Rubén
Objective: Artificial Intelligence (AI) in electrocardiogram (ECG) analysis helps to identify persons at risk of developing atrial fibrillation (AF) and reduces the risk for severe complications. Our aim is to investigate the performance of AI-based methods predicting future AF from sinus rhythm (SR) ECGs, according to different characteristics of patients, time intervals for prediction, and longitudinal measures. Methods: We designed a retrospective, prognostic study to predict AF occurrence in patients from 12-lead SR ECGs. We classified patients in two groups, according to their ECGs: 3,761 developed AF and 22,896 presented only SR ECGs. We assessed the impact of age on the overall performance of deep neural network (DNN)-based systems, which consist in a variation of Residual Networks for time series. Then, we analysed how much in advance our system can predict AF from SR ECGs and the performance for different categories of patients with AUC and other metrics. Results: After balancing the age distribution between the two groups of patients, our model achieves AUC of 0.79 (0.72-0.86) without additional constraints, 0.83 (0.76-0.89) for ECGs recorded in the last six months before AF, and 0.87 (0.81-0.93) for patients with stable AF risk measures over time, with sensitivity of 90.62% (80.70-96.48) and diagnostic odd ratio of 20.49 (8.56-49.09). Conclusion: This study shows the ability of DNNs to predict new onsets of AF from SR ECGs, with the best performance achieved for patients with stable AF risk score over time. The introduction of this time-based score opens new possibilities for AF prediction, thanks to the analysis of long-span time intervals and score stability, European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No860813 – TReSPAsS-ETNTRESPASS-ETN
Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

FRCSyn-onGoing: Benchmarking and comprehensive evaluation of real and synthetic data to improve face recognition systems

  • Melzi, Pietro
  • Vera Rodríguez, Rubén
  • Andrés Tamé, Iván Ioel de
  • Morales Moreno, Aythami
  • Fiérrez Aguilar, Julián
  • Ortega García, Javier
  • Tolosana Moranchel, Rubén
Artículo escrito por un elevado número de autores, solo se referencian el que aparece en primer lugar, el nombre del grupo de colaboración, si le hubiere, y los autores pertenecientes a la UAM, This article presents FRCSyn-onGoing, an ongoing challenge for face recognition where researchers can easily benchmark their systems against the state of the art in an open common platform using large-scale public databases and standard experimental protocols. FRCSyn-onGoing is based on the Face Recognition Challenge in the Era of Synthetic Data (FRCSyn) organized at WACV 2024. This is the first face recognition international challenge aiming to explore the use of real and synthetic data independently, and also their fusion, in order to address existing limitations in the technology. Specifically, FRCSyn-onGoing targets concerns related to data privacy issues, demographic biases, generalization to unseen scenarios, and performance limitations in challenging scenarios, including significant age disparities between enrollment and testing, pose variations, and occlusions. To enhance face recognition performance, FRCSyn-onGoing strongly advocates for information fusion at various levels, starting from the input data, where a mix of real and synthetic domains is proposed for specific tasks of the challenge. Additionally, participating teams are allowed to fuse diverse networks within their proposed systems to improve the performance. In this article, we provide a comprehensive evaluation of the face recognition systems and results achieved so far in FRCSyn-onGoing. The results obtained in FRCSynonGoing, together with the proposed public ongoing benchmark, contribute significantly to the application of synthetic data to improve face recognition technology, This study has received funding from the European Union’s Horizon 2020 TReSPAsS-ETN (No 860813) and is supported by INTER-ACTION, Spain (PID2021-126521OB-I00 MICINN/FEDER), Cátedra ENIA UAM-VERIDAS en IA Responsable (NextGeneration EU PRTR TSI-100927-2023-2), Spain R&D Agreement DGGC/UAM/FUAM for Biometrics and Cybersecurity, Spain, and Autonomous Community of Madrid (ELLIS Unit Madrid). MeVer was supported by the EU Horizon Europe project MAMMOth (Grant Agreement 101070285)