Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Enhancing OmpSs-2 suspendable tasks by combining operating system and user-level threads with C++ coroutines

  • Cinca Roca, Arnau
  • Roca Nonell, Aleix|||0000-0002-6715-3605
  • Sala Penadés, Kevin|||0000-0001-8233-1185
  • Peñacoba Veigas, Raúl
  • Álvarez Robert, David
  • Beltran Querol, Vicenç
This paper explores three methods for implementing suspendable tasks within task-based programming models: OS threads (pthreads), User-Level Threads (ULTs), and C++ coroutines. We enhance the OmpSs-2 programming model, originally supporting suspendable tasks via pthreads, to also accommodate ULTs and C++ coroutines. This unified approach facilitates a comprehensive comparative analysis using various benchmarks that includes recursive fork-join and data-flow parallelization strategies. Additionally, we contrast these suspension methods with the Cilk and OpenMP task-based programming models, which, despite their efficiency, lack support for suspendable tasks. Key contributions of this study include the novel integration of C++20 coroutines into the OmpSs-2 programming model, which can be combined with pthreads or ULTs. Furthermore, we introduce a new Linux kernel syscall that accelerates pthread context switches by an order of magnitude, thus narrowing the performance gap between ULTs and pthreads in context-switch times from two to one order of magnitude. C++ Coroutines are the ideal solution for scenarios where many tasks are simultaneously in a suspended state, or the frequency of task suspension and resumption is high because they have the smallest memory footprint and minor contextswitch overhead. However, they are limited to C++ programs, do not support TLS, and only allow task suspension at top-level functions. Still, pthreads and ULTs can bring remarkable benefits where C++ Coroutines cannot. We conclude that combining the strengths of coroutines with pthreads or ULTs brings productivity and performance benefits for programming models., This work was partially supported by the Generalitat de Catalunya (contract 2021-SGR-01007) and the Spanish Government through the Severo Ochoa Program (CEX2021-001148-S/MCIN/AEI/10.13039/501100011033). It is also part of the research project PID2023-147979NB-C21, funded by MICIU/AEI (10.13039/501100011033) and co-financed by the European Regional Development Fund (FEDER, EU). Additionally, this work was developed in the context of the European PILOT project, which has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No. 101034126, with support from the European Union's Horizon 2020 research and innovation program and Spain, Italy, Switzerland, Germany, France, Greece, Sweden, Croatia, and Turkey. This paper is also co-financed by the Barcelona Zettaescale Laboratory (reference REGAGE22e00058408992), promoted by the Ministry for Digital Transformation and the Civil Service, within the framework of the Recovery, Transformation and Resilience Plan - Funded by the European Union - NextGenerationEU., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

RAVE: RISC-V analyzer of vector executions, a QEMU tracing plugin

  • Vizcaíno Serrano, Pablo
  • Mantovani, Filippo|||0000-0003-3559-4825
  • Labarta Mancho, Jesús José|||0000-0002-7489-4727
  • Ferrer Ibañez, Roger
Simulators are crucial during the development of a chip, like the RISC-V accelerator designed in the European Processor Initiative project. In this paper, we showcase the limitations of the current simulation solutions in the project and propose using QEMU with RAVE, a plugin we implement and describe in this document. This methodology can rapidly simulate and analyze applications running on the v1.0 and v0.7.1 RISC-V V-extension. Our plugin reports the vector and scalar instructions alongside useful information such as the vector-length being used, the single-element-width, and the register usage, among other vectorization metrics. We provide an API used from the simulated Application to control the RAVE plugin and the capability to generate vectorization traces that can be analyzed using Paraver. Finally, we demonstrate the efficiency of our solution between different evaluated machines and against other simulation methods used in the European Processor Accelerator (EPAC) project., Supported by the EuroHPC Joint Undertaking (JU): FPA N. 800928 (EPI), SGA N. 101036168 (EPI-SGA2) GA N. 101034126 (The European PILOT). Also supported by the Horizon Europe research and innovation funding programme, GA N. 101092993 (RISER). The JU receives support from the EU Horizon 2020 research and innovation programme and from Croatia, France, Germany, Greece, Italy, Netherlands, Portugal, Spain, Sweden, Denmark and Switzerland. The EPI-SGA2 project, PCI2022-132935 is also co-funded by MCIN/AEI /10.13039/501100011033 and by the UE NextGenerationEU/PRTR., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Efficient direct convolution using long SIMD instructions

  • Limas Santana, Alexandre de
  • Armejach Sanosa, Adrià|||0000-0003-2869-668X
  • Casas, Marc|||0000-0003-4564-2093
This paper demonstrates that state-of-the-art proposals to compute convolutions on architectures with CPUs supporting SIMD instructions deliver poor performance for long SIMD lengths due to frequent cache conflict misses. We first discuss how to adapt the state-of-the-art SIMD direct convolution to architectures using long SIMD instructions and analyze the implications of increasing the SIMD length on the algorithm formulation. Next, we propose two new algorithmic approaches: the Bounded Direct Convolution (BDC), which adapts the amount of computation exposed to mitigate cache misses, and the Multi-Block Direct Convolution (MBDC), which redefines the activation memory layout to improve the memory access pattern. We evaluate BDC, MBDC, the state-of-the-art technique, and a proprietary library on an architecture featuring CPUs with 16,384-bit SIMD registers using ResNet convolutions. Our results show that BDC and MBDC achieve respective speed-ups of 1.44× and 1.28× compared to the state-of-the-art technique for ResNet-101, and 1.83× and 1.63× compared to the proprietary library., This work receives EuroHPC-JU funding under grant no. 101034126, with support from the Horizon2020 program. Adrià Armejach is a Serra Hunter Fellow and has been partially supported by the Grant IJCI-2017-33945 funded by MCIN/AEI/10.13039/501100011033. Marc Casas has been par-tially supported by the Grant RYC-2017-23269 funded by MCIN/AEI/10.13039/501100011033 and ESF Investing in your future. This work is supported by the Spanish Ministry of Science and Technology through the PID2019-107255GB project and the Generalitat de Catalunya (contract 2017-SGR-1414)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Designing a QEMU plugin to profile multicore long vector RISC-V architectures: RAVE

  • Vizcaíno Serrano, Pablo
  • Ferrer Ibañez, Roger
  • Labarta Mancho, Jesús José|||0000-0002-7489-4727
  • Mantovani, Filippo|||0000-0003-3559-4825
Simulators are crucial during the development of a chip, like the RISC-V accelerator designed in the European Processor Initiative project. In this paper, we showcase the limitations of the current emulation solutions in the project and propose using QEMU with RAVE, a plugin we implement and describe in this document. This methodology can rapidly emulate and analyze applications running on the v1.0 and v0.7.1 RISC-V V-extension. Our plugin reports the vector and scalar instructions alongside useful information such as the vector-length being used, the single-element-width, and the register usage, among other vectorization metrics. We provide an API used from the emulated Application to control the RAVE plugin and the capability to generate vectorization traces that can be analyzed using Paraver. Additionally, we demonstrate the efficiency of our solution against other emulators such as Whipser, ETISS, Spike, or FPGA simulation. Finally, we describe the challenges and solutions for synchronizing and emulating multi-threaded and multi-process binaries, and evaluate the performance of RAVE running on multiple processors., Supported by the EuroHPC Joint Undertaking (JU): FPA N. 800928 (EPI), SGA N. 101036168 (EPI-SGA2) GA N. 101034126 (The European PILOT). Also supported by the Horizon Europe research and innovation funding programme, GA N. 101092993 (RISER). The JU receives support from the EU Horizon 2020 research and innovation programme and from Croatia, France, Germany, Greece, Italy, Netherlands, Portugal, Spain, Sweden, Denmark and Switzerland. The EPI-SGA2 project, PCI2022-132935 is also co-funded by MCIN/AEI /10.13039/501100011033 and by the UE NextGenerationEU/PRTR., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Unleashing the Potential of Mixed Precision in AI-Accelerated CFD Simulation on Intel CPU/GPU Architectures

  • Halbiniak, Kamil
  • Rojek, Krzysztof
  • Iserte, Sergio
  • Wyrzykowski, Roman
The 7-volume set LNCS 14832 – 14838 constitutes the proceedings of the 24th International Conference on Computational Science, ICCS 2024, which took place in Malaga, Spain, during July 2–4, 2024. The 155 full papers and 70 short papers included in these proceedings were carefully reviewed and selected from 430 submissions. They were organized in topical sections as follows: Part I: ICCS 2024 Main Track Full Papers; Part II: ICCS 2024 Main Track Full Papers; Part III: ICCS 2024 Main Track Short Papers; Advances in High-Performance Computational Earth Sciences: Numerical Methods, Frameworks and Applications; Artificial Intelligence and High-Performance Computing for Advanced Simulations; Part IV: Biomedical and Bioinformatics Challenges for Computer Science; Computational Health; Part V: Computational Optimization, Modelling, and Simulation; Generative AI and Large Language Models (LLMs) in Advancing Computational Medicine; Machine Learning and Data Assimilation for Dynamical Systems; Multiscale Modelling and Simulation; Part VI: Network Models and Analysis: From Foundations to Artificial Intelligence; Numerical Algorithms and Computer Arithmetic for Computational Science; Quantum Computing; Part VII: Simulations of Flow and Transport: Modeling, Algorithms and Computation; Smart Systems: Bringing Together Computer Vision, Sensor Networks, and Artificial Intelligence; Solving Problems with Uncertainties; Teaching Computational Science, CFD has emerged as an indispensable tool for comprehending and refining fluid flow phenomena within engineering domains. The recent integration of CFD with AI has unveiled novel avenues for expedited simulations and computing precision. This research paper delves into the accuracy of amalgamating CFD with AI and assesses its performance across modern server-class Intel CPU/GPU architectures such as the 4th generation of Intel Xeon Scalable CPUs (codename Sapphire Rapids) and Intel Data Center Max GPUs (or Ponte Vecchio). Our investigation focuses on exploring the potential of mixed-precision techniques with diverse number formats, namely, FP32, FP16, and BF16, to accelerate CFD computations through AI-based methods. Particular emphasis is given to validating outcomes to ensure their applicability across a CFD motorBike simulation. This research explores the performance/accuracy trade-off for both AI training and simulations, including OpenFOAM solver and interference with the trained model, across various data types available on Intel CPUs/GPUs. We aim to provide a thorough understanding of how different number formats impact the performance and accuracy of the DNN-based model in various application scenarios running on modern HPC architectures., We extend our sincere gratitude to byteLAKE. Their support and collaboration have been instrumental in our research and development endeavors. The researcher from BSC is involved in the project The European PILOT which has received funding from the European High-Performance Computing Joint Undertaking under grant agreement No. 101034126 and No. PCI2021-122090-2A under the MCIN/AEI and the EU NextGenerationEU/PRTR., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Designing a QEMU plugin to profile multicore long vector RISC-V architectures: RAVE

  • Vizcaíno Serrano, Pablo
  • Ferrer Ibañez, Roger
  • Labarta Mancho, Jesús José
  • Mantovani, Filippo
Simulators are crucial during the development of a chip, like the RISC-V accelerator designed in the European Processor Initiative project. In this paper, we showcase the limitations of the current emulation solutions in the project and propose using QEMU with RAVE, a plugin we implement and describe in this document. This methodology can rapidly emulate and analyze applications running on the v1.0 and v0.7.1 RISC-V V-extension. Our plugin reports the vector and scalar instructions alongside useful information such as the vector-length being used, the single-element-width, and the register usage, among other vectorization metrics. We provide an API used from the emulated Application to control the RAVE plugin and the capability to generate vectorization traces that can be analyzed using Paraver. Additionally, we demonstrate the efficiency of our solution against other emulators such as Whipser, ETISS, Spike, or FPGA simulation. Finally, we describe the challenges and solutions for synchronizing and emulating multi-threaded and multi-process binaries, and evaluate the performance of RAVE running on multiple processors., Supported by the EuroHPC Joint Undertaking (JU): FPA N. 800928 (EPI), SGA N. 101036168 (EPI-SGA2) GA N. 101034126 (The European PILOT). Also supported by the Horizon Europe research and innovation funding programme, GA N. 101092993 (RISER). The JU receives support from the EU Horizon 2020 research and innovation programme and from Croatia, France, Germany, Greece, Italy, Netherlands, Portugal, Spain, Sweden, Denmark and Switzerland. The EPI-SGA2 project, PCI2022-132935 is also co-funded by MCIN/AEI /10.13039/501100011033 and by the UE NextGenerationEU/PRTR., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Unleashing the Potential of Mixed Precision in AI-Accelerated CFD Simulation on Intel CPU/GPU Architectures

  • Halbiniak, Kamil
  • Rojek, Krzysztof
  • Iserte, Sergio
  • Wyrzykowski, Roman
The 7-volume set LNCS 14832 – 14838 constitutes the proceedings of the 24th International Conference on Computational Science, ICCS 2024, which took place in Malaga, Spain, during July 2–4, 2024. The 155 full papers and 70 short papers included in these proceedings were carefully reviewed and selected from 430 submissions. They were organized in topical sections as follows: Part I: ICCS 2024 Main Track Full Papers; Part II: ICCS 2024 Main Track Full Papers; Part III: ICCS 2024 Main Track Short Papers; Advances in High-Performance Computational Earth Sciences: Numerical Methods, Frameworks and Applications; Artificial Intelligence and High-Performance Computing for Advanced Simulations; Part IV: Biomedical and Bioinformatics Challenges for Computer Science; Computational Health; Part V: Computational Optimization, Modelling, and Simulation; Generative AI and Large Language Models (LLMs) in Advancing Computational Medicine; Machine Learning and Data Assimilation for Dynamical Systems; Multiscale Modelling and Simulation; Part VI: Network Models and Analysis: From Foundations to Artificial Intelligence; Numerical Algorithms and Computer Arithmetic for Computational Science; Quantum Computing; Part VII: Simulations of Flow and Transport: Modeling, Algorithms and Computation; Smart Systems: Bringing Together Computer Vision, Sensor Networks, and Artificial Intelligence; Solving Problems with Uncertainties; Teaching Computational Science, CFD has emerged as an indispensable tool for comprehending and refining fluid flow phenomena within engineering domains. The recent integration of CFD with AI has unveiled novel avenues for expedited simulations and computing precision. This research paper delves into the accuracy of amalgamating CFD with AI and assesses its performance across modern server-class Intel CPU/GPU architectures such as the 4th generation of Intel Xeon Scalable CPUs (codename Sapphire Rapids) and Intel Data Center Max GPUs (or Ponte Vecchio). Our investigation focuses on exploring the potential of mixed-precision techniques with diverse number formats, namely, FP32, FP16, and BF16, to accelerate CFD computations through AI-based methods. Particular emphasis is given to validating outcomes to ensure their applicability across a CFD motorBike simulation. This research explores the performance/accuracy trade-off for both AI training and simulations, including OpenFOAM solver and interference with the trained model, across various data types available on Intel CPUs/GPUs. We aim to provide a thorough understanding of how different number formats impact the performance and accuracy of the DNN-based model in various application scenarios running on modern HPC architectures., We extend our sincere gratitude to byteLAKE. Their support and collaboration have been instrumental in our research and development endeavors. The researcher from BSC is involved in the project The European PILOT which has received funding from the European High-Performance Computing Joint Undertaking under grant agreement No. 101034126 and No. PCI2021-122090-2A under the MCIN/AEI and the EU NextGenerationEU/PRTR., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

RAVE: RISC-V analyzer of vector executions, a QEMU tracing plugin

  • Vizcaíno Serrano, Pablo
  • Mantovani, Filippo
  • Labarta Mancho, Jesús José
  • Ferrer Ibañez, Roger
Simulators are crucial during the development of a chip, like the RISC-V accelerator designed in the European Processor Initiative project. In this paper, we showcase the limitations of the current simulation solutions in the project and propose using QEMU with RAVE, a plugin we implement and describe in this document. This methodology can rapidly simulate and analyze applications running on the v1.0 and v0.7.1 RISC-V V-extension. Our plugin reports the vector and scalar instructions alongside useful information such as the vector-length being used, the single-element-width, and the register usage, among other vectorization metrics. We provide an API used from the simulated Application to control the RAVE plugin and the capability to generate vectorization traces that can be analyzed using Paraver. Finally, we demonstrate the efficiency of our solution between different evaluated machines and against other simulation methods used in the European Processor Accelerator (EPAC) project., Supported by the EuroHPC Joint Undertaking (JU): FPA N. 800928 (EPI), SGA N. 101036168 (EPI-SGA2) GA N. 101034126 (The European PILOT). Also supported by the Horizon Europe research and innovation funding programme, GA N. 101092993 (RISER). The JU receives support from the EU Horizon 2020 research and innovation programme and from Croatia, France, Germany, Greece, Italy, Netherlands, Portugal, Spain, Sweden, Denmark and Switzerland. The EPI-SGA2 project, PCI2022-132935 is also co-funded by MCIN/AEI /10.13039/501100011033 and by the UE NextGenerationEU/PRTR., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Efficient direct convolution using long SIMD instructions

  • Limas Santana, Alexandre de
  • Armejach Sanosa, Adrià
  • Casas, Marc
This paper demonstrates that state-of-the-art proposals to compute convolutions on architectures with CPUs supporting SIMD instructions deliver poor performance for long SIMD lengths due to frequent cache conflict misses. We first discuss how to adapt the state-of-the-art SIMD direct convolution to architectures using long SIMD instructions and analyze the implications of increasing the SIMD length on the algorithm formulation. Next, we propose two new algorithmic approaches: the Bounded Direct Convolution (BDC), which adapts the amount of computation exposed to mitigate cache misses, and the Multi-Block Direct Convolution (MBDC), which redefines the activation memory layout to improve the memory access pattern. We evaluate BDC, MBDC, the state-of-the-art technique, and a proprietary library on an architecture featuring CPUs with 16,384-bit SIMD registers using ResNet convolutions. Our results show that BDC and MBDC achieve respective speed-ups of 1.44× and 1.28× compared to the state-of-the-art technique for ResNet-101, and 1.83× and 1.63× compared to the proprietary library., This work receives EuroHPC-JU funding under grant no. 101034126, with support from the Horizon2020 program. Adrià Armejach is a Serra Hunter Fellow and has been partially supported by the Grant IJCI-2017-33945 funded by MCIN/AEI/10.13039/501100011033. Marc Casas has been par-tially supported by the Grant RYC-2017-23269 funded by MCIN/AEI/10.13039/501100011033 and ESF Investing in your future. This work is supported by the Spanish Ministry of Science and Technology through the PID2019-107255GB project and the Generalitat de Catalunya (contract 2017-SGR-1414)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Enhancing OmpSs-2 suspendable tasks by combining operating system and user-level threads with C++ coroutines

  • Cinca Roca, Arnau
  • Roca Nonell, Aleix
  • Sala Penadés, Kevin
  • Peñacoba Veigas, Raúl
  • Álvarez Robert, David
  • Beltran Querol, Vicenç
This paper explores three methods for implementing suspendable tasks within task-based programming models: OS threads (pthreads), User-Level Threads (ULTs), and C++ coroutines. We enhance the OmpSs-2 programming model, originally supporting suspendable tasks via pthreads, to also accommodate ULTs and C++ coroutines. This unified approach facilitates a comprehensive comparative analysis using various benchmarks that includes recursive fork-join and data-flow parallelization strategies. Additionally, we contrast these suspension methods with the Cilk and OpenMP task-based programming models, which, despite their efficiency, lack support for suspendable tasks. Key contributions of this study include the novel integration of C++20 coroutines into the OmpSs-2 programming model, which can be combined with pthreads or ULTs. Furthermore, we introduce a new Linux kernel syscall that accelerates pthread context switches by an order of magnitude, thus narrowing the performance gap between ULTs and pthreads in context-switch times from two to one order of magnitude. C++ Coroutines are the ideal solution for scenarios where many tasks are simultaneously in a suspended state, or the frequency of task suspension and resumption is high because they have the smallest memory footprint and minor contextswitch overhead. However, they are limited to C++ programs, do not support TLS, and only allow task suspension at top-level functions. Still, pthreads and ULTs can bring remarkable benefits where C++ Coroutines cannot. We conclude that combining the strengths of coroutines with pthreads or ULTs brings productivity and performance benefits for programming models., This work was partially supported by the Generalitat de Catalunya (contract 2021-SGR-01007) and the Spanish Government through the Severo Ochoa Program (CEX2021-001148-S/MCIN/AEI/10.13039/501100011033). It is also part of the research project PID2023-147979NB-C21, funded by MICIU/AEI (10.13039/501100011033) and co-financed by the European Regional Development Fund (FEDER, EU). Additionally, this work was developed in the context of the European PILOT project, which has received funding from the European High-Performance Computing Joint Undertaking (JU) under grant agreement No. 101034126, with support from the European Union's Horizon 2020 research and innovation program and Spain, Italy, Switzerland, Germany, France, Greece, Sweden, Croatia, and Turkey. This paper is also co-financed by the Barcelona Zettaescale Laboratory (reference REGAGE22e00058408992), promoted by the Ministry for Digital Transformation and the Civil Service, within the framework of the Recovery, Transformation and Resilience Plan - Funded by the European Union - NextGenerationEU., Peer Reviewed, Postprint (author's final draft)