Pasar al contenido principal

APRENDIZAJE AUTOMATICO ESCALABLE Y EXPLICABLE

PID2019-109238GB-C22

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDADE DA CORUÑA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 29
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

FedHEONN: Federated and homomorphically encrypted learning method for one-layer neural networks

  • Fontenla-Romero, Óscar
  • Guijarro-Berdiñas, Bertha
  • Hernández-Pereira, Elena
  • Pérez-Sánchez, Beatriz
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Federated learning (FL) is a distributed approach to developing collaborative learning models from decentralized data. This is relevant to many real applications, such as in the field of the Internet of Things, since the models can be used in edge computing devices. FL approaches are motivated by and designed to protect privacy, a highly relevant issue given current data protection regulations. Although FL methods are privacy-preserving by design, recently published papers show that privacy leaks do occur, caused by attacks designed to extract private data from information interchanged during learning. In this work, we present an FL method based on a neural network without hidden layers that incorporates homomorphic encryption (HE) to enhance robustness against the above-mentioned attacks. Unlike traditional FL methods that require multiple rounds of training for convergence, our method obtains the collaborative global model in a single training round, yielding an effective and efficient model that simplifies management of the FL training process. In addition, since our method includes HE, it is also robust against model inversion attacks. In experiments with big data sets and a large number of clients in a federated scenario, we demonstrate that use of HE does not affect the accuracy of the model, whose results are competitive with state-of-the-art machine learning models. We also show that behavior in terms of accuracy is the same for identically and non-identically distributed data scenarios., This work has been supported by the grant Machine Learning on the Edge - Ayudas Fundación BBVA a Equipos de Investigación Científica 2019; the National Plan for Scientific and Technical Research and Innovation of the Spanish Government (Grants PID2019-109238GB-C2 and PID2021-128045OA-I00); and by the Xunta de Galicia (ED431C 2022/44) with the European Union ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades (Ref. ED431G 2019/01). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

A novel framework for generic Spark workload characterization and similar pattern recognition using machine learning

  • Garralda-Barrio, Mariano
  • Eiras-Franco, Carlos
  • Bolón-Canedo, Verónica
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Comprehensive workload characterization plays a pivotal role in comprehending Spark applications, as it enables the analysis of diverse aspects and behaviors. This understanding is indispensable for devising downstream tuning objectives, such as performance improvement. To address this pivotal issue, our work introduces a novel and scalable framework for generic Spark workload characterization, complemented by consistent geometric measurements. The presented approach aims to build robust workload descriptors by profiling only quantitative metrics at the application task-level, in a non-intrusive manner. We expand our framework for downstream workload pattern recognition by incorporating unsupervised machine learning techniques: clustering algorithms and feature selection. These techniques significantly improve the process of grouping similar workloads without relying on predefined labels. We effectively recognize 24 representative Spark workloads from diverse domains, including SQL, machine learning, web search, graph, and micro-benchmarks, available in HiBench. Our framework achieves a high accuracy F-Measure score of up to 90.9% and a Normalized Mutual Information of up to 94.5% in similar workload pattern recognition. These scores significantly outperform the results obtained in a comparative analysis with an established workload characterization approach in the literature., This work was supported by CITIC, as Research Center accredited by Galician University System, which is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). It was also partially funded by Xunta de Galicia/FEDER-UE under Grant ED431C 2022/44; Ministerio de Ciencia e Innovación MCIN/AEI/10.13039/501100011033 under Grant PID2019-109238 GB-C22., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2022/44
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

The imbalance problem: A comparison of sampling approaches using different parameters and feature selection methods in the context of classification

  • Morillo-Salas, José Luis
  • Bolón-Canedo, Verónica
  • Alonso-Betanzos, Amparo
This is the peer reviewed version of the following article: Morillo-Salas, J. L., Bolón-Canedo, V., & Alonso-Betanzos, A. (2024). The imbalance problem: A comparison of sampling approaches using different parameters and feature selection methods in the context of classification. Expert Systems, 41(8), e13591, which has been published in final form at https://doi.org/10.1111/exsy.13591., [Abstract]: A common situation in classification tasks is to deal with unbalanced datasets, an issue that appears when the majority class(es) has a large number of samples compared to the minority class(es). This problem is even more significant when the datasets have a large number of features but only a few samples, as is the case with microarray datasets. Traditionally, an approach to alleviate this problem has been the application of sampling methods to obtain more balanced classes, increasing the number of samples in the minority class (replicating samples or generating new synthetic samples), or decreasing the number of samples in the majority class. In this study, we have compared different balancing methods, including a novel method that applies sampling in both the minority and majority classes. The interest in applying feature selection in combination with balancing methods has also been explored. In view of the results, a recommendation of sampling method, feature selection, and classifier is proposed to improve the classification results according to the type of dataset., This work has been supported by Ministerio de Ciencia e Innovación MCIN/- AEI/10.13039/501100011033 under Grant PID2019-109238GB-C22, and by the Xunta de Galicia (Grant ED431C 2022/44) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidades from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Positive-Unlabelled Learning for Identifying New Candidate Dietary Restriction-Related Genes Among Ageing-Related Genes

  • Paz Ruza, Jorge
  • Freitas, Alex A.
  • Alonso-Betanzos, Amparo
  • Guijarro-Berdiñas, Bertha
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Dietary Restriction (DR) is one of the most popular anti-ageing interventions; recently, Machine Learning (ML) has been explored to identify potential DR-related genes among ageing-related genes, aiming to minimize costly wet lab experiments needed to expand our knowledge on DR. However, to train a model from positive (DR-related) and negative (non-DR-related) examples, the existing ML approach naively labels genes without known DR relation as negative examples, assuming that lack of DR-related annotation for a gene represents evidence of absence of DR-relatedness, rather than absence of evidence. This hinders the reliability of the negative examples (non-DR-related genes) and the method’s ability to identify novel DR-related genes. This work introduces a novel gene prioritization method based on the two-step Positive-Unlabelled (PU) Learning paradigm: using a similarity-based, KNN-inspired approach, our method first selects reliable negative examples among the genes without known DR associations. Then, these reliable negatives and all known positives are used to train a classifier that effectively differentiates DR-related and non-DR-related genes, which is finally employed to generate a more reliable ranking of promising genes for novel DR-relatedness. Our method significantly outperforms (p<0.05) the existing state-of-the-art approach in three predictive accuracy metrics with up to ∼40% lower computational cost in the best case, and we identify 4 new promising DR-related genes (PRKAB1, PRKAB2, IRS2, PRKAG1), all with evidence from the existing literature supporting their potential DR-related role., This research work has been funded by MICIU/AEI/10.13039/501100011033 and ESF+ (grant FPU21/05783), MICIU/AEI/10.13039/ 501100011033/ and ERDF A way of making Europe (grant PID2019-109238GB-C22), and by the Xunta de Galicia (Grant ED431C 2022/44) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Operational Programme Galicia 2021–2027, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2023/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2023/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Low-Precision Feature Selection on Microarray Data: An Information Theoretic Approach

  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
  • Alonso-Betanzos, Amparo
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The number of interconnected devices, such as personal wearables, cars, and smart-homes, surrounding us every day has recently increased. The Internet of Things devices monitor many processes, and have the capacity of using machine learning models for pattern recognition, and even making decisions, with the added advantage of diminishing network congestion by allowing computations near to the data sources. The main restriction is the low computation capacity of these devices. Thus, machine learning algorithms capable of maintaining accuracy while using mechanisms that exploit certain characteristics, such as low-precision versions, are needed. In this paper, low-precision mutual information-based feature selection algorithms are employed over DNA microarray datasets, showing that 16-bit and some times even 8-bit representations of these algorithms can be used without significant variations in the final classification results achieved., This work has been supported by the grant Machine Learning on the Edge - Ayudas Fundación BBVA a Equipos de Investigación Científica 2019. It has also been possible thanks to the support received by the National Plan for Scientific and Technical Research and Innovation of the Spanish Government (Grant PID2019-109238GB-C2), and by the Xunta de Galicia (Grant ED431C 2018/34) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidades from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature, Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Real-time Analysis of Indoor Sports Game Situations through Deep Learning-based Classification

  • Cabado, Bruno
  • Guijarro-Berdiñas, Bertha
  • Padrón, Emilio J.
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG Play by Play dataset (Cabado, Guijarro-Berdiñas, & Padrón, 2025) in Zenodo: https://doi.org/10.5281/zenodo.12607661., [Abstract]: Live indoor sports broadcasts require dynamic camera control in response to relevant game situations such as penalties or timeouts, a process that traditionally relies on human operators. This paper presents a solution for automatic real-time classification of game states in indoor invasion sports, with handball as the primary case study and basketball as a secondary validation scenario. Our approach utilizes raw video directly from cameras, enabling real-time analysis. The system continuously processes video frames, assigning each to one of seven classes: left/right attack, left/right counterattack, left/right penalty, and timeout. A synthetic representation of each frame is used to standardize the depiction of game dynamics. The proposed pipeline includes object detection with a fine-tuned You Only Look Once (YOLO) model to locate players, the ball, and referees; object tracking to compute velocity vectors; generation of a synthetic frame representing the current game state; and final classification using a custom Dense Convolutional Network (DenseNet). Using a dataset of 20 handball matches, the proposed system achieved a macro-averaged F1-score of 96.1%, with a per-image inference time below 4 ms, evaluated on 118,129 images from matches unseen during training. The same pipeline was subsequently applied to basketball using only two matches, achieving an F1-score of 92.5% on 12,390 images, thereby illustrating the transferability of the proposed approach to other indoor invasion sports. The full pipeline operates in 34.04 ms with GPU acceleration, processing over 25 frames per second., This work was supported by Grants PID2019-109238GB-C22 and PID2022-136435NB-I00, funded by MCIN/AEI/10.13039/501100011033 and by “ERDF A way of making Europe”, EU; and by Xunta de Galicia [ED431C 2022/44 ED431B 2025/21]. CITIC, as a center accredited for excellence within the Galician University System and a member of the CIGUS Network, receives subsidies from the Department of Education, Science, Universities, and Vocational Training of the Xunta de Galicia. Additionally, it is co-financed by the EU through the FEDER Galicia 2021-27 operational program (Ref. ED431G 2023/01). Cabado wish to thanks the Axencia Galega de Innovación the grant received through its Industrial Doctorate program (23/IN606D/2021/2612054). The authors also thank Universidade da Coruña/CISUG for funding the open access charges., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431B 2025/21, Xunta de Galicia; ED431G 2023/01, Xunta de Galicia; IN606D/2021/2612054
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

On the Reliability of Machine Learning Models for Survival Analysis When Cure Is a Possibility

  • Ezquerro, Ana
  • Cancela, Brais
  • López-Cheda, Ana
[Abstract]: In classical survival analysis, it is assumed that all the individuals will experience the event of interest. However, if there is a proportion of subjects who will never experience the event, then a standard survival approach is not appropriate, and cure models should be considered instead. This paper deals with the problem of adapting a machine learning approach for classical survival analysis to a situation when cure (i.e., not suffering the event) is a possibility. Specifically, a brief review of cure models and recent machine learning methodologies is presented, and an adaptation of machine learning approaches to account for cured individuals is introduced. In order to validate the proposed methods, we present an extensive simulation study in which we compare the performance of the adapted machine learning algorithms with existing cure models. The results show the good behavior of the semiparametric or the nonparametric approaches, depending on the simulated scenario. The practical utility of the methodology is showcased through two real-world dataset illustrations. In the first one, the results show the gain of using the nonparametric mixture cure model approach. In the second example, the results show the poor performance of some machine learning methods for small sample sizes., This project was funded by the Xunta de Galicia (Axencia Galega de Innovación) Research projects COVID-19 presented in ISCIII IN845D 2020/26, Operational Program FEDER Galicia 2014–2020; by the Centro de Investigación de Galicia “CITIC”, funded by Xunta de Galicia and the European Union European Regional Development Fund (ERDF)-Galicia 2014–2020 Program, by grant ED431G 2019/01; and by the Spanish Ministerio de Economía y Competitividad (research projects PID2019-109238GB-C22 and PID2021-128045OA-I00). ALC was sponsored by the BEATRIZ GALINDO JUNIOR Spanish Grant from MICINN (Ministerio de Ciencia e Innovación) with code BGP18/00154. ALC was partially supported by the MICINN Grant PID2020-113578RB-I00 and partial support of Xunta de Galicia (Grupos de Referencia Competitiva ED431C-2020-14). We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C-2020-14, Xunta de Galicia; IN845D 2020/26
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Data-driven predictive maintenance framework for railway systems

  • Meira, Jorge
  • Veloso, Bruno
  • Bolón-Canedo, Verónica
  • Marreiros, Goreti
  • Alonso-Betanzos, Amparo
  • Gama, João
This version of the article has been accepted for publication, after peer review. The Version of Record is available online at: https://doi.org/10.3233/ida-226811., [Abstract]: The emergence of the Industry 4.0 trend brings automation and data exchange to industrial manufacturing. Using computational systems and IoT devices allows businesses to collect and deal with vast volumes of sensorial and business process data. The growing and proliferation of big data and machine learning technologies enable strategic decisions based on the analyzed data. This study suggests a data-driven predictive maintenance framework for the air production unit (APU) system of a train of Metro do Porto. The proposed method assists in detecting failures and errors in machinery before they reach critical stages. We present an anomaly detection model following an unsupervised approach, combining the Half-Space-trees method with One Class K Nearest Neighbor, adapted to deal with data streams. We evaluate and compare our approach with the Half-Space-Trees method applied without the One Class K Nearest Neighbor combination. Our model produced few type-I errors, significantly increasing the value of precision when compared to the Half-Space-Trees model. Our proposal achieved high anomaly detection performance, predicting most of the catastrophic failures of the APU train system., This research has been financially supported in part by the Spanish Ministerio de Economia y Competitividad (research project PID2019-109238GB-C22), and by the Xunta de Galicia (Grants ED431C 2018/34 and ED431G 2019/01) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by Consellería de Cultura, Educación e Universidades from Xunta de Galicia, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by Secretaría Xeral de Universidades (Grant ED431G 2019/01). This work was also supported by National Funds through the FCT - Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology) within the Project UIDB/00760/2020 and UIDP/00760/2020. This work was supported by the CHIST-ERA grant CHIST-ERA-19-XAI-012, and project CHIST-ERA/0004/2019 funded by FCT., Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431G 2019/01, Portugal. Fundação para a Ciência e a Tecnologia; UIDB/00760/2020, Portugal. Fundação para a Ciência e a Tecnologia; UIDP/00760/2020, Portugal. Fundação para a Ciência e a Tecnologia; CHIST-ERA/0004/2019, Suecia. Vetenskapsrådet; CHIST-ERA-19-XAI-012
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Scalable Feature Selection Using ReliefF Aided by Locality-Sensitive Hashing

  • Eiras-Franco, Carlos
  • Guijarro-Berdiñas, Bertha
  • Alonso-Betanzos, Amparo
  • Bahamonde, Antonio
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] Feature selection algorithms, such as ReliefF, are very important for processing high-dimensionality data sets. However, widespread use of popular and effective such algorithms is limited by their computational cost. We describe an adaptation of the ReliefF algorithm that simplifies the costliest of its step by approximating the nearest neighbor graph using locality-sensitive hashing (LSH). The resulting ReliefF-LSH algorithm can process data sets that are too large for the original ReliefF, a capability further enhanced by distributed implementation in Apache Spark. Furthermore, ReliefF-LSH obtains better results and is more generally applicable than currently available alternatives to the original ReliefF, as it can handle regression and multiclass data sets. The fact that it does not require any additional hyperparameters with respect to ReliefF also avoids costly tuning. A set of experiments demonstrates the validity of this new approach and confirms its good scalability., This study has been supported in part by the Spanish Ministerio de Economía y Competitividad (projects PID2019-109238GB-C2 and TIN 2015-65069-C2-1-R and 2-R), partially funded by FEDER funds of the EU and by the Xunta de Galicia (projects ED431C 2018/34 and Centro Singular de Investigación de Galicia, accreditation 2016-2019). The authors wish to thank the Fundación Pública Galega Centro Tecnolóxico de Supercomputación de Galicia (CESGA) for the use of their computing resources. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2018/34
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Do All Roads Lead to Rome? Studying Distance Measures in the Context of Machine Learning

  • Blanco-Mallo, Eva
  • Morán-Fernández, Laura
  • Remeseiro, Beatriz
  • Bolón-Canedo, Verónica
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Many machine learning and data mining tasks are based on distance measures, so a large amount of literature addresses this aspect somehow. Due to the broad scope of the topic, this paper aims to provide an overview of the use of these measures in the most common machine learning problems, pointing out those aspects to consider to choose the most appropriate measure for a particular task. For this purpose, the most recent works addressing the subject were reviewed and seven of the most commonly used measures were analyzed, investigating in detail their main properties and applications. Different experiments were carried out to study their relationships and compare their performance. The degradation of the results in the presence of noise was also considered, as well as the execution time required by each measure., This work has been supported by the National Plan for Scientific and Technical Research and Innovation of the Spanish Government (Grant PID2019-109238GB, subprojects C21 and C22), by the Spanish Ministry of Science and Innovation (Grant FPI PRE2020-092608), and by the Xunta de Galicia (Grant ED431C 2022/44) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidades from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fast Deep Autoencoder for Federated Learning

  • Novoa-Paradela, David
  • Fontenla-Romero, Óscar
  • Guijarro-Berdiñas, Bertha
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: This paper presents a novel, fast and privacy preserving implementation of deep autoencoders. DAEF (Deep AutoEncoder for Federated learning), unlike traditional neural networks, trains a deep autoencoder network in a non-iterative way, which drastically reduces training time. Training can be performed incrementally, in parallel and distributed and, thanks to its mathematical formulation, the information to be exchanged does not endanger the privacy of the training data. The method has been evaluated and compared with other state-of-the-art autoencoders, showing interesting results in terms of accuracy, speed and use of available resources. This makes DAEF a valid method for edge computing and federated learning, in addition to other classic machine learning scenarios., This work was supported in part by grant Machine Learning on the Edge - Ayudas Fundación BBVA a Equipos de Investigación Científica 2019; the Spanish National Plan for Scientific and Technical Research and Innovation (PID2019-109238GB-C22 and TED2021-130599A-I00); the Xunta de Galicia (ED431C 2022/44) and ERDF funds. CITIC is funded by Xunta de Galicia and ERDF funds. Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2022/44
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

“Play by play”: A dataset of handball and basketball game situations in a standardized space

  • Cabado, Bruno
  • Guijarro-Berdiñas, Bertha
  • Padrón, Emilio J.
Data Availability: "Play by Play": a dataset of handball and basketball game situations in a standardized space (Original data) (Zenodo): https://doi.org/10.5281/zenodo.12698090, [Abstract]: This paper presents a synthetic dataset of labeled game situations in recordings of federated handball and basketball matches played in Galicia, Spain. The dataset consists of synthetic data generated from real video frames, including 308,805 labeled handball frames and 56,578 labeled basketball frames extracted from 2105 handball and 383 basketball 5-s video clips. Experts manually labeled the video clips based on the respective sports, while the individual frames were automatically labeled using computer vision and machine learning techniques. The dataset encompasses seven classes of game situations: left attack, left counterattack, left penalty, right attack, right counterattack, right penalty, and timeout. In basketball, the penalty class refers to the free throws attempted by players after they have been fouled by an opposing player. Each frame in the dataset is assigned to one of these classes, considering the game situation and specific context. Importantly, the dataset does not contain actual video frames; instead, it provides a synthetic, normalized representation of each frame in JSON format. This tabular data includes player, referee, and ball positions on a normalized field, player and referee velocities, and key regions on the court. Positions of players, referees, and the ball were automatically inferred in each frame by an object detector, followed by a tracking step to detect object positions across frames and compute the velocity vectors. Finally, the obtained coordinates underwent normalization through a perspective transformation, ensuring that the data remained unaffected by variations in camera configurations across different arenas and camera setups. We refer to this standardized coordinate space as the 'unified space'. The dataset holds significant potential for reuse in various domains related to sports analytics and machine learning research. It can serve as a valuable resource for researchers, coaches, and sports enthusiasts, contributing to improvements in player performance, game strategies, match retransmissions, and sports-related technologies., This work was supported by Grants PID2019-109238GB-C22 and PID2022-136435NB-I00, funded by MICINN/AEI/10.13039/501100011033, by Xunta de Galicia (Grants ED431C 2022/44, ED431C 2021/30, ED431F 2021/11) and by `ERDF A way of making Europe', EU. CITIC, as a center accredited for excellence within the Galician University System and a member of the CIGUS Network, receives subsidies from the Department of Education, Science, Universities, and Vocational Training of the Xunta de Galicia. Additionally, it is co-financed by the EU through the FEDER Galicia 2021-27 operational program (Ref. ED431G 2023/01). Cabado wish to thanks the Axencia Galega de Innovación the grant received through its Industrial Doctorate program (23/IN606D/2021/2612054)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431C 2021/30, Xunta de Galicia; ED431F 2021/11, Xunta de Galicia; ED431G 2023/01, Xunta de Galicia; IN606D/2021/2612054
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Finding a needle in a haystack: insights on feature selection for classification tasks

  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: The growth of Big Data has resulted in an overwhelming increase in the volume of data available, including the number of features. Feature selection, the process of selecting relevant features and discarding irrelevant ones, has been successfully used to reduce the dimensionality of datasets. However, with numerous feature selection approaches in the literature, determining the best strategy for a specific problem is not straightforward. In this study, we compare the performance of various feature selection approaches to a random selection to identify the most effective strategy for a given type of problem. We use a large number of datasets to cover a broad range of real-world challenges. We evaluate the performance of seven popular feature selection approaches and five classifiers. Our findings show that feature selection is a valuable tool in machine learning and that correlation-based feature selection is the most effective strategy regardless of the scenario. Additionally, we found that using improper thresholds with ranker approaches produces results as poor as randomly selecting a subset of features., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research has been financially supported in part by the Spanish Ministerio de Ciencia e Innovación MCIN/AEI/10.13039/501100011033 and “NextGenerationEU”/PRTR under Grants [PID2019-109238GB-C22; TED2021-130599A-I00], and by the Xunta de Galicia (ED431C 2022/44) with the European Union ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia, Spain through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades (Ref. ED431G 2019/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Spatial–temporal feature-based End-to-end Fourier network for 3D sign language recognition

  • Abdullahi, Sunusi Bala
  • Chamnongthai, Kosin
  • Bolón-Canedo, Verónica
  • Cancela, Brais
This is the Accepted Manuscript. This version of the article has been accepted for publication in: Expert Systems with Applications, 248, 123258. The Version of Record is available online at https://doi.org/10.1016/j.eswa.2024.123258., [Abstract]: Most dynamic sign word misclassifications are caused by redundant spatial–temporal (SPT) feature pruning that lacks language semantic and temporal dependencies. SPT feature recognition is one of the important aspects for the evaluation of the misclassification of dynamic sign words. The redundant pruning of SPT feature space influences the language model of sign confusion, model complexity, and SPT feature similarity. The purpose of this article is to develop a new multi-scale SPT feature-based dynamic sign word recognition approach via a low-cost feature selection method (FS) and End-to-end Fourier convolution neural network (EFCNN). Instead of a sensor fusion technique for obtaining frame position alignment, in the EFCNN, new 3D frame position and coordinates are determined using a pixel weighting and alignment function of the first and succeeding 25 spatial intensities of the 3D video changes across hand motion. The new spatial weight and the original spatial coordinates are fused and truncated in the Fourier domain. We generate the temporal dependence of the fused features. A feature selection known as the FS-EFCNN is introduced to select compact features with a preserved language meaning. Five state-of-the-art feature selection methods, namely Infinite FS (InFS), Relief FS, Fisher, MIM, ILFS, and ensemble FS-EFCNN were deployed to guide and optimize the learning performance of EFCNN. The experimental result analysis highlighted the improved results of the FS-EFCNN method with the best accuracy of 99.86%, 99.89%, and 90.69% on 3D American Sign Language, British Sign Language, and Greek Sign Language data sets, respectively., This research has been financially supported in part by the Spanish Ministerio de Ciencia e Innovación MCIN/AEI/10.13039/501100011033 and ”NextGenerationEU”/PRTR under Grants [PID2019-109238GB-C22; PID2021-128045OA-I00; TED2021-130599A-I00], and by the Xunta de Galicia (ED431C 2022/44) with the European Union ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia, Spain through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades (Ref. ED431G 2019/01). This research is also supported by King Mongkut’s University of Technology Thonburi’s Postdoctoral Fellowship Under Research Project ID 27180., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01, Thailand. King Mongkut's University of Technology Thonburi; 27180
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Feature Selection for Domain Adaptation Using Complexity Measures and Swarm Intelligence

  • Castillo-García, G.
  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Particle Swarm Optimization is an optimization algorithm that mimics the behaviour of a flock of birds, setting multiple particles that explore the search space guided by a fitness function in order to find the best possible solution. We apply the Sticky Binary Particle Swarm Optimization algorithm to perform feature selection for domain adaptation, a specific type of transfer learning in which the source and the target domain have a common feature space, a common task, but different distributions. When applying Particle Swarm Optimization, classification error is usually employed in the fitness function to evaluate the goodness of subsets of features. In this paper, we aim to compare this approach with using complexity metrics instead, under the assumption that reducing the complexity of the problem will lead to results that are independent from the classifier used for testing while being less computationally demanding. Therefore, we carried out experiments to compare the performance of both approaches in terms of classification accuracy, speed and number of features selected. We found out that our proposal, although in some cases incurs in a slight degradation of classification performance, it is indeed faster and selects fewer features, making it a feasible trade-off., This work was supported by CITIC, as Research Center accredited by Galician University System, which is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). It was also partially funded by Xunta de Galicia/FEDER-UE under Grant ED431C 2022/44; Ministerio de Ciencia e Innovación MCIN/AEI/10.13039/501100011033 and “NextGenerationEU”/PRTR under Grants [PID2019-109238GB-C22; TED2021-130599A-I00]., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2022/44
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Beyond RMSE and MAE: Introducing EAUC to Unmask Hidden Bias and Unfairness in Dyadic Regression Models

  • Paz Ruza, Jorge
  • Alonso-Betanzos, Amparo
  • Guijarro-Berdiñas, Bertha
  • Cancela, Brais
  • Eiras-Franco, Carlos
[Abstract]: Dyadic regression models, which output real-valued predictions for pairs of entities, are fundamental in many domains [e.g., obtaining user-product ratings in recommender systems (RSs)] and promising and under exploration in others (e.g., tuning patient–drug dosages in precision pharmacology). In this work, we prove that nonuniform observed value distributions of individual entities lead to severe biases in state-of-the-art models, skewing predictions toward the average of observed past values for the entity and providing worse-than-random predictive power in eccentric yet crucial cases; we name this phenomenon eccentricity bias. We show that global error metrics like root-mean-squared error (RMSE) are insufficient to capture this bias, and we introduce eccentricity area under the curve (EAUC) as a novel metric that can quantify it in all studied domains and models. We prove the intuitive interpretation of EAUC by experimenting with naive post-training bias corrections and theorize other options to use EAUC to guide the construction of fair models. This work contributes a bias-aware evaluation of dyadic regression to prevent unfairness in critical real-world applications of such systems., This work was supported in part by MICIU/AEI/10.13039/501100011033 and ESF+ under Grant FPU21/05783; in part by MICIU/AEI/10.13039/501100011033 under Grant PID2019-109238GB-C22; in part by MICIU/AEI/10.13039/501100011033 and ERDF, EU under Grant PID2023-147404OB-I00 and Grant PID2021-128045OA-I00; in part by the Ministry for Digital Transformation and Civil Service and Next-Generation EU/PRTR under Grant TSI-100925-2023-1; in part by the Xunta de Galicia under Grant ED431C 2022/44; and in part by Consellería de Cultura, Educación e Universidade (ERDF Operational Programme Galicia 2021–2027) and Secretaría Xeral de Universidades under Grant ED431G 2023/01., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2023/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

CUDA Acceleration of MI-Based Feature Selection Methods

  • Beceiro, Bieito
  • González-Domínguez, Jorge
  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
  • Touriño, Juan
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Feature selection algorithms are necessary nowadays for machine learning as they are capable of removing irrelevant and redundant information to reduce the dimensionality of the data and improve the quality of subsequent analyses. The problem with current feature selection approaches is that they are computationally expensive when processing large datasets. This work presents parallel implementations for Nvidia GPUs of three highly-used feature selection methods based on the Mutual Information (MI) metric: mRMR, JMI and DISR. Publicly available code includes not only CUDA implementations of the general methods, but also an adaptation of them to work with low-precision fixed point in order to further increase their performance on GPUs. The experimental evaluation was carried out on two modern Nvidia GPUs (Turing T4 and Ampere A100) with highly satisfactory results, achieving speedups of up to 283x when compared to state-of-the-art C implementations., This work was supported by grants PID2019-104184RB-I00, PID- 2019-109238GB-C22, TED2021-130599A-I00 and PID2022-136435NB- I00, funded by MCIN/AEI/ 10.13039/501100011033 (TED2021 also funded by “NextGenerationEU”/PRTR and PID2022 by “ERDF A way of making Europe”, EU). Grant TSI-100925-2023-1, funded by Ministry for Digital Transformation and Civil Service. FPU predoctoral grant of Bieito Beceiro ref. FPU20/00997, funded by the Ministry of Sci- ence, Innovation and Universities. We gratefully thank the Galician Supercomputing Center (CESGA) for the access granted to its super- computing resources. Funding for open access charge: Universidade da Coruña/CISUG.
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

DSVD-autoencoder: A scalable distributed privacy-preserving method for one-class classification

  • Fontenla-Romero, Óscar
  • Pérez-Sánchez, Beatriz
  • Guijarro-Berdiñas, Bertha
This is the peer reviewed version of the following article: DSVD-autoencoder: A scalable distributed privacy-preserving method for one-class classification, which has been published in final form at https://doi.org/10.1002/int.22296. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions. This article may not be enhanced, enriched or otherwise transformed into a derivative work, without express permission from Wiley or by statutory rights under applicable legislation. Copyright notices must not be removed, obscured or modified. The article must be linked to Wiley’s version of record on Wiley Online Library and any embedding, framing or otherwise making available the article or pages thereof by third parties from platforms, services and websites other than Wiley Online Library must be prohibited., [Abstract]: One-class classification has gained interest as a solution to certain kinds of problems typical in a wide variety of real environments like anomaly or novelty detection. Autoencoder is the type of neural network that has been widely applied in these one-class problems. In the Big Data era, new challenges have arisen, mainly related with the data volume. Another main concern derives from Privacy issues when data is distributed and cannot be shared among locations. These two conditions make many of the classic and brilliant methods not applicable. In this paper, we present distributed singular value decomposition (DSVD-autoencoder), a method for autoencoders that allows learning in distributed scenarios without sharing raw data. Additionally, to guarantee privacy, it is noniterative and hyperparameter-free, two interesting characteristics when dealing with Big Data. In comparison with the state of the art, results demonstrate that DSVD-autoencoder provides a highly competitive solution to deal with very large data sets by reducing training from several hours to seconds while maintaining good accuracy., This work has been supported by the grant Machine Learning on the Edge - Ayudas Fundación BBVA a Equipos de Investigación Científica 2019. It has also been possible thanks to the support received by theNational Plan for Scientific and Technical Research and Innovation of the Spanish Government (Grants TIN2015-65069-C2-1-R and PID2019-109238GB-C2), and by the Xunta de Galicia (Grant ED431C 2018/34) with the European Union ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades (Ref. ED431G 2019/01)., Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Adaptive incremental transfer learning for efficient performance modeling of big data workloads

  • Garralda-Barrio, Mariano
  • Eiras-Franco, Carlos
  • Bolón-Canedo, Verónica
This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/bync-nd/4.0/. This version of the article has been accepted for publication in Future Generation Computer Systems. The Version of Record is available online at https://doi.org/10.1016/j.future.2025.107730, The algorithms, evaluation metrics, cross-validation methods, and resources used in this study are openly available at https://github.com/mgarralda/garralda-performance-model. Further details can be obtained from the corresponding author on reasonable request., [Abstract]: The rise of data-intensive scalable computing systems, such as Apache Spark, has transformed data processing by enabling the efficient manipulation of large datasets across machine clusters. However, system configuration to optimize performance remains a challenge. This paper introduces an adaptive incremental transfer learning approach to predicting workload execution times. By integrating both unsupervised and supervised learning, we develop models that adapt incrementally to new workloads and configurations. To guide the optimal selection of relevant workloads, the model employs the coefficient of distance variation (CdV) and the coefficient of quality correlation (CqC), combined in the exploration–exploitation balance coefficient (EEBC). Comprehensive evaluations demonstrate the robustness and reliability of our model for performance modeling in Spark applications, with average improvements of up to 31% over state-of-the-art methods. This research contributes to efficient performance tuning systems by enabling transfer learning from historical workloads to new, previously unseen workloads. The full source code is openly available., This work has been supported by the National Plan for Scientific and Technical Research and Innovation of the Spanish Government, Spain (Grant PID2019-109238GB-C22 and PID2023-147404OB-I00), and by the Xunta de Galicia (Grant ED431C 2022/44) with the European Union ERDF funds, Spain. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia, Spain ”, supported in an 80% through ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2023/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2023/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Towards Federated Feature Selection: Logarithmic Division for Resource-Conscious Methods

  • Suárez-Marcote, Samuel
  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Feature selection is a popular preprocessing step to reduce the dimensionality of the data while preserving the important information. In this paper, we propose an efficient and green feature selection method based on information theory, with the novelty of using the logarithmic division and resorting to fixed-point precision. Moreover, we extend these advancements by adapting the Mutual Information calculation for federated scenarios. The results of experiments conducted on several datasets indicate the potential of our proposal, as it does not incur significant information loss compared to the double-precision method, both in the features selected and in the subsequent classification step. Our method has shown significant potential when applied in federated scenarios, where experimentation demonstrated a lossless feature selection process and maintains classification results compared with centralised versions. These findings open up possibilities towards a new family of green feature selection methods, which would help to minimise energy consumption, lower carbon emissions and increase adaptability to Internet of Things environments., This research has been financially supported in part by the Spanish Ministerio de Ciencia e Innovación MCIN/AEI/10.13039/501100011033 and “NextGenerationEU”/PRTR, Spain under Grants [PID2019-109238GB-C22; TED2021-130599A-I00], by Ministry for Digital Transformation and Civil Service, Spain under grant TSI-100925-2023-1 and by the Xunta de Galicia, Spain (ED431C 2022/44) with the European Union ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia, Spain through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades, Spain (Ref. ED431G 2023/01). It has also been supported by the Programa de axudas á etapa predoutoral of the Consellería de Cultura, Educación, Universidade e Formación Profesional, Xunta de Galicia, Spain (Ref. ED481A 2023/034). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2023/01, Xunta de Galicia; ED481A 2023/034
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

A review of green artificial intelligence: Towards a more sustainable future

  • Bolón-Canedo, Verónica
  • Morán-Fernández, Laura
  • Cancela, Brais
  • Alonso-Betanzos, Amparo
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Green artificial intelligence (AI) is more environmentally friendly and inclusive than conventional AI, as it not only produces accurate results without increasing the computational cost but also ensures that any researcher with a laptop can perform high-quality research without the need for costly cloud servers. This paper discusses green AI as a pivotal approach to enhancing the environmental sustainability of AI systems. Described are AI solutions for eco-friendly practices in other fields (green-by AI), strategies for designing energy-efficient machine learning (ML) algorithms and models (green-in AI), and tools for accurately measuring and optimizing energy consumption. Also examined are the role of regulations in promoting green AI and future directions for sustainable ML. Underscored is the importance of aligning AI practices with environmental considerations, fostering a more eco-conscious and energy-efficient future for AI systems., This work was supported by CITIC, a Research Center accredited by Galician University System, which is funded by "Consellería de Cultura, Educación e Universidade from Xunta de Galicia", supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by "Secretaría Xeral de Universidades" (Grant ED431G 2019/01). It was also partially funded by Xunta de Galicia/FEDER-UE under Grant ED431C 2022/44; Ministerio de Ciencia e Innovación MCIN/AEI/10.13039/501100011033 and "NextGenerationEU"/PRTR under Grants [PID2019-109238GB-C22; PID2021-128045OA-I00; ED2021-130599A-I00] and Ministry for Digital Transformation and Civil Service under grant TSI-100925-2023-1. Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2022/44
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Performance and sustainability of BERT derivatives in dyadic data

  • Escarda Fernández, Miguel
  • Eiras-Franco, Carlos
  • Cancela, Brais
  • Guijarro-Berdiñas, Bertha
  • Alonso-Betanzos, Amparo
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: In recent years, the Natural Language Processing (NLP) field has experienced a revolution, where numerous models – based on the Transformer architecture – have emerged to process the ever-growing volume of online text-generated data. This architecture has been the basis for the rise of Large Language Models (LLMs). Enabling their application to many diverse tasks in which they excel with just a fine-tuning process that comes right after a vast pre-training phase. However, their sustainability can often be overlooked, especially regarding computational and environmental costs. Our research aims to compare various BERT derivatives in the context of a dyadic data task while also drawing attention to the growing need for sustainable AI solutions. To this end, we utilize a selection of transformer models in an explainable recommendation setting, modeled as a multi-label classification task originating from a social network context, where users, restaurants, and reviews interact., Research funded by the Spain Ministry of Science, Innovation and Universities (MCIN/AEI/10.13039/501100011033) and ERDF “A way of making Europe” (PID2019-109238GB-C22, PID2021-128045OA-I00, PID2023-147404OB-I00), by the “Xunta de Galicia” (ED431C 2022/44) with the European Union ERDF funds, and by the Ministry for Digital Transformation and Civil Service and “Next-GenerationEU”/PRTR (Grant TSI-100925-2023-1). CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia ”, supported in an 80% through ERDF Operational Programme Galicia 2014-2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2023/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2023/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fed-mRMR: A lossless federated feature selection method

  • Hermo González, Jorge
  • Bolón-Canedo, Verónica
  • Ladra, Susana
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, Implementation can be found at: https://github.com/jorgehermo9/fed-mrmr, [Abstract]: Feature selection has become a mandatory task in data mining, due to the overwhelming amount of features in Big Data problems. To handle this high-dimensional data and avoid the well-known curse of dimensionality, we need to pre-select an optimal subset of features to reduce redundant computations. Federated learning is a machine learning technique based on training an algorithm over many decentralized edge devices holding local rather than global data on a centralized server. Application of this technique is extending to fields such as self-driving cars, medicine and health, and Industry 4.0, where data privacy is compulsory. Feature selection through federated learning is a complicated task since suboptimal features calculated by feature selection methods may be different in heterogeneous datasets from different nodes. In this paper, we propose a lossless federated version of the classic minimum redundancy maximum relevance (mRMR) feature selection algorithm, called federated mRMR (fed-mRMR), which, without losing any effectiveness of the original mRMR method, is applicable to federated learning approaches and capable of dealing with data that are not independent and identically distributed (non-IID data). Implementation can be found at: https://github.com/jorgehermo9/fed-mrmr, This work was supported by CITIC, a Research Center accredited by the Galician University System, funded by the Xunta de Galicia Consellería de Cultura, Educación e Universidade, supported 80% by ERDF/FEDER funds (Operational Programme Information Sciences 669 (2024) 120609 14 J. Hermo, V. Bolón-Canedo and S. Ladra Galicia 2014-2020) and 20% by the Xunta de Galicia Secretaría Xeral de Universidades (Grant ED431G 2019/01). It was also partially funded by the Xunta de Galicia and ERDF/FEDER (Grants ED431C 2021/53; ED431C 2022/44), the Spanish Ministerio de Ciencia e Innovación (MCIN/AEI/10.13039/501100011033) and NextGenerationEU/PRTR (Grants PDC2021-121239-C31; PID2019-105221RB-C41; PID2019-109238GB-C22; PID2022-141027NB-C2; TED2021-130599A-I00; TSI-100925-2023-1). A department collaboration grant awarded by Universidade de A Coruña also supported this research., Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431C 2021/53, Xunta de Galicia; ED431C 2022/44
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Fast anomaly detection with locality-sensitive hashing and hyperparameter autotuning

  • Meira, Jorge
  • Eiras-Franco, Carlos
  • Bolón-Canedo, Verónica
  • Marreiros, Goreti
  • Alonso-Betanzos, Amparo
[Abstract]: This paper presents LSHAD, an anomaly detection (AD) method based on Locality Sensitive Hashing (LSH), capable of dealing with large-scale datasets. The resulting algorithm is highly parallelizable and its implementation in Apache Spark further increases its ability to handle very large datasets. Moreover, the algorithm incorporates an automatic hyperparameter tuning mechanism so that users do not have to implement costly manual tuning. Our LSHAD method is novel as both hyperparameter automation and distributed properties are not usual in AD techniques. Our results for experiments with LSHAD across a variety of datasets point to state-of-the-art AD performance while handling much larger datasets than state-of-the-art alternatives. In addition, evaluation results for the tradeoff between AD performance and scalability show that our method offers significant advantages over competing methods., This research has been financially supported in part by the Spanish Ministerio de Economía y Competitividad (project PID-2019-109238GB-C22) and by the Xunta de Galicia (grants ED431C 2018/34 and ED431G 2019/01) through European Union ERDF funds. CITIC, as a research center accredited by the Galician University System, is funded by the Consellería de Cultura, Educación e Universidades of the Xunta de Galicia, supported 80% through ERDF Funds (ERDF Operational Programme Galicia 2014–2020) and 20% by the Secretaría Xeral de Universidades (Grant ED431G 2019/01).This work was also supported by National Funds through the Portuguese FCT - Fundação para a Ciência e a Tecnologia (projects UIDB/00760/2020 and UIDP/00760/2020)., Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

How Important Is Data Quality? Best Classifiers vs Best Features

  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
  • Alonso-Betanzos, Amparo
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] The task of choosing the appropriate classifier for a given scenario is not an easy-to-solve question. First, there is an increasingly high number of algorithms available belonging to different families. And also there is a lack of methodologies that can help on recommending in advance a given family of algorithms for a certain type of datasets. Besides, most of these classification algorithms exhibit a degradation in the performance when faced with datasets containing irrelevant and/or redundant features. In this work we analyze the impact of feature selection in classification over several synthetic and real datasets. The experimental results obtained show that the significance of selecting a classifier decreases after applying an appropriate preprocessing step and, not only this alleviates the choice, but it also improves the results in almost all the datasets tested., This work has been supported by the National Plan for Scientific and Technical Research and Innovation of the Spanish Government (Grant PID2019-109238 GB-C2), and by the Xunta de Galicia (Grant ED431C 2018/34) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidades from Xunta de Galicia”, supported in an 80% through ERDF Funds, ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01). Funding for open access charge: Universidade da Coruña/CISUG, Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Breaking Boundaries: Low-Precision Conditional Mutual Information for Efficient Feature Selection

  • Morán-Fernández, Laura
  • Blanco-Mallo, Eva
  • Sechidis, Konstantinos
  • Bolón-Canedo, Verónica
[Abstract] As internet-of-things (IoT) devices proliferate, the need for efficient data processing at the network edge becomes increasingly critical due to the vast amounts of data generated. This paper presents a groundbreaking approach that leverages edge computing to address these challenges, using low-precision conditional mutual information (CMI) for feature selection. Our novel methodology improves the efficiency of edge computing systems by significantly reducing memory and energy consumption while maintaining high accuracy. We adapt this approach to feature selection algorithms, specifically, conditional mutual information maximization (CMIM) and incremental association Markov blanket (IAMB), and demonstrate its effectiveness for diverse datasets, including complex DNA microarrays. Our results show that low-precision methods not only compare competitively with traditional 64-bit implementations, but also yield significant performance and resource savings. For IoT and other machine learning applications, this work represents a significant advance in the development of more sustainable and efficient algorithms that can optimize computational resources and reduce their environmental impact., This work was supported in part by Xunta de Galicia/FEDER-UE under Grant ED431G 2023/01; Ministerio de Ciencia e Innovacion MCIN/AEI/10.13039/501100011033 and ‘Next-GenerationEU’/PRTR under Grants [PID2019-109238GB-C22; TED2021-130599A-I00; PID2023-147404OB-I00] and Ministry for Digital Transformation and Civil Service and ‘Next-GenerationEU’/PRTR under grant TSI-100925-2023-1. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educacion, Universidade e Formación Profesional of the Xunta de Galicia, Spain through the European Regional Development Fund (ERDF/FEDER) and the Secretaría Xeral de Universidades (ED431G 2023/01)., Xunta de Galicia; ED431G 2023/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Sustainable transparency on recommender systems: Bayesian ranking of images for explainability

  • Paz Ruza, Jorge
  • Alonso-Betanzos, Amparo
  • Guijarro-Berdiñas, Bertha
  • Cancela, Brais
  • Eiras-Franco, Carlos
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract]: Recommender Systems have become crucial in the modern world, commonly guiding users towards relevant content or products, and having a large influence over the decisions of users and citizens. However, ensuring transparency and user trust in these systems remains a challenge; personalized explanations have emerged as a solution, offering justifications for recommendations. Among the existing approaches for generating personalized explanations, using existing visual content created by users is a promising option to maximize transparency and user trust. State-of-the-art models that follow this approach, despite leveraging highly optimized architectures, employ surrogate learning tasks that do not efficiently model the objective of ranking images as explanations for a given recommendation; this leads to a suboptimal training process with high computational costs that may not be reduced without affecting model performance. This work presents BRIE, a novel model where we leverage Bayesian Pairwise Ranking to enhance the training process, allowing us to consistently outperform state-of-the-art models in six real-world datasets while reducing its model size by up to 64 times and its CO2 emissions by up to 75% in training and inference., This research work has been funded by MICIU/AEI /10.13039/501100011033 and ESF+ (grant FPU21/05783), ERDF A way of making Europe (PID2019-109238GB-C22) and ERDF/EU (PID2021-128045OA-I00), and by the Xunta de Galicia, Spain (Grant ED431C 2022/44) with the European Union ERDF funds. CITIC, as Research Center accredited by Galician University System, is funded by “Consellería de Cultura, Educación e Universidade from Xunta de Galicia ”, supported in an 80% through ERDF Operational Programme Galicia 2014–2020, and the remaining 20% by “Secretaría Xeral de Universidades” (Grant ED431G 2019/01)., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431G 2019/01
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Explained anomaly detection in text reviews: Can subjective scenarios be correctly evaluated?

  • Novoa-Paradela, David
  • Fontenla-Romero, Óscar
  • Guijarro-Berdiñas, Bertha
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG, [Abstract] In the current landscape, user opinions exert an unprecedented influence on the trajectory of companies. In the field of online review platforms, these opinions, transmitted through text reviews and numerical ratings, significantly shape the credibility of products and services. For this reason, detecting inappropriate reviews becomes crucial. This paper addresses the problem of automatic anomalous review detection using a novel approach based on Anomaly Detection in the field of Natural Language Processing (NLP). Unlike other NLP tasks, anomaly detection in texts is a relatively emerging area. In this paper, we present a pipeline for opinion filtering that poses the problem of discerning between normal opinions containing relevant information about an item and anomalous opinions with unrelated content. Its key functionalities include: Classifying the reviews, assigning normality scores, and generating explanations for each classification, indispensable for the human who normally moderates these platforms. To evaluate the model, several Amazon datasets were used to demonstrate that the performance obtained is robust, obtaining an average F1 score of 91.4 detecting anomalies in the most complex scenario. In addition, a comparative study of three explainability techniques was conducted with 241 participants to measure the impact on understanding the classifications of the model and to rank their perceived usefulness of explanations. As a result, we obtained a system with great potential to automate tasks related to online review platforms, offering insights into anomaly detection applications in textual data and showing the difficulties that arise when the task to be explained presents a subjectivity component., This work was supported in part by grant Machine Learning on the Edge - Ayudas Fundación BBVA a Equipos de Investigación Científica 2019; the Spanish National Plan for Scientific and Technical Research and Innovation (PID2019-109238GB-C22 and TED2021-130599A-I00); the Xunta de Galicia (ED431C 2022/44) and ERDF funds. CITIC, as a Research Center of the University System of Galicia, is funded by Consellería de Educación, Universidade e Formación Profesional of the Xunta de Galicia, Spain through the European Regional Development Fund (ERDF) and the Secretaría Xeral de Universidades (Ref. ED431C 2022/44). Funding for open access charge: Universidade da Coruña/CISUG., Xunta de Galicia; ED431C 2022/44, Xunta de Galicia; ED431C 2022/44
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

Dealing with heterogeneity in the context of distributed feature selection for classification

  • Morillo-Salas, José Luis
  • Bolón-Canedo, Verónica
  • Alonso-Betanzos, Amparo
This version of the article has been accepted for publication, after peer review and is subject to Springer Nature’s AM terms of use, but is not the Version of Record and does not reflect post-acceptance improvements, or any corrections. The Version of Record is available online at: https://doi.org/10.1007/s10115-020-01526-4., [Abstract]: Advances in the information technologies have greatly contributed to the advent of larger datasets. These datasets often come from distributed sites, but even so, their large size usually means they cannot be handled in a centralized manner. A possible solution to this problem is to distribute the data over several processors and combine the different results. We propose a methodology to distribute feature selection processes based on selecting relevant and discarding irrelevant features. This preprocessing step is essential for current high-dimensional sets, since it allows the input dimension to be reduced. We pay particular attention to the problem of data imbalance, which occurs because the original dataset is unbalanced or because the dataset becomes unbalanced after data partitioning. Most works approach unbalanced scenarios by oversampling, while our proposal tests both over- and undersampling strategies. Experimental results demonstrate that our distributed approach to classification obtains comparable accuracy results to a centralized approach, while reducing computational time and efficiently dealing with data imbalance., This research has been financially supported in part by the Spanish Ministerio de Economía y Competitividad (research projects TIN2015-65069-C2-1-R and PID2019-109238GB-C22), by European Union FEDER funds and by the Consellería de Industria of the Xunta de Galicia (research project ED431C 2018/34). Financial support from the Xunta de Galicia (Centro singular de investigación de Galicia accreditation 2016–2019) and the European Union (European Regional Development Fund—ERDF), is gratefully acknowledged (research project ED431G 2019/01)., Xunta de Galicia; ED431C 2018/34, Xunta de Galicia; ED431G 2019/01