Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 2
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

CUDA acceleration of MI-based feature selection methods

  • Beceiro, Bieito
  • González-Domínguez, Jorge
  • Morán-Fernández, Laura
  • Bolón-Canedo, Verónica
  • Touriño, Juan
[Abstract]: Feature selection algorithms are necessary nowadays for machine learning as they are capable of removing irrelevant and redundant information to reduce the dimensionality of the data and improve the quality of subsequent analyses. The problem with current feature selection approaches is that they are computationally expensive when processing large datasets. This work presents parallel implementations for Nvidia GPUs of three highly-used feature selection methods based on the Mutual Information (MI) metric: mRMR, JMI and DISR. Publicly available code includes not only CUDA implementations of the general methods, but also an adaptation of them to work with low-precision fixed point in order to further increase their performance on GPUs. The experimental evaluation was carried out on two modern Nvidia GPUs (Turing T4 and Ampere A100) with highly satisfactory results, achieving speedups of up to 283x when compared to state-of-the-art C implementations., This work was supported by grants PID2019-104184RB-I00, PID- 2019-109238GB-C22, TED2021-130599A-I00 and PID2022-136435NB- I00, funded by MCIN/AEI/ 10.13039/501100011033 (TED2021 also funded by “NextGenerationEU”/PRTR and PID2022 by “ERDF A way of making Europe”, EU). Grant TSI-100925-2023-1, funded by Ministry for Digital Transformation and Civil Service. FPU predoctoral grant of Bieito Beceiro ref. FPU20/00997, funded by the Ministry of Sci- ence, Innovation and Universities. We gratefully thank the Galician Supercomputing Center (CESGA) for the access granted to its super- computing resources. Funding for open access charge: Universidade da Coruña/CISUG., Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG
RUC. Repositorio da Universidade da Coruña
Publicación Artículo científico (JournalArticle)

A Multi-Backend Autotuning Study of Feature Selection on GPUs

  • Beceiro, Bieito
  • González-Domínguez, Jorge
  • Pérez Diéguez, Adrián
  • Ibrahim, Khaled Z.
  • Touriño, Juan
Financiado para publicación en acceso aberto: Universidade da Coruña/CISUG The code for the CUDA, HIP, and SYCL backends for mRMR used in the experimental evaluation is available at https://gitlab.com/bieito/gpufs. The datasets analyzed in this study are available in the LIBSVM repository, https://www.csie.ntu.edu.twcjlin/libsvmtools/datasets/, [Abstract]: Feature selection is an important step in machine learning that can benefit from GPU acceleration. As the number of GPU vendors increases, it is imperative to adapt algorithms such as the minimum Redundancy Maximum Relevance (mRMR) feature selection method to different backends that support several GPU architectures. This work presents a multi-backend implementation of mRMR across CUDA, HIP, and SYCL, and studies its performance when combined with Bayesian optimization and transfer learning to automatically tune execution parameters for different platforms and datasets. Our experimental results show that when tuned, CUDA and HIP achieve comparable performance on NVIDIA architectures, while SYCL exhibits a moderate performance gap. Overall, this work highlights the impact of backend choice and autotuning on GPU-accelerated feature selection and provides insights into deploying mRMR across heterogeneous environments., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was supported by grants PID2022-136435NB-I00 and PID2025-167767NB-I00, funded by MICIU/AEI/10.13039/501100011033 and “ERDF A way of making Europe”, EU; grant TSI-100925-2023-1, funded by the Ministry for Digital Transformation and Civil Service and Next-GenerationEU/RRF; FPU predoctoral grant of Bieito Beceiro ref. FPU20/00997, funded by the Ministry of Science, Innovation and Universities; and INDITEX-UDC Predoctoral Research Stay Grants Program 2024. In addition, this material is based upon work supported by the U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research, Scientific Discovery through Advanced Computing (SciDAC) program under Award Number DE-AC02-05CH11231. Funding for open access charge: Universidade da Coruña/CISUG., United States. Department of Energy; DE-AC02-05CH11231, https://gitlab.com/bieito/gpufs