Pasar al contenido principal

ARQUITECTURA Y PROGRAMACION DE COMPUTADORES ESCALABLES DE ALTO RENDIMIENTO Y BAJO CONSUMO III - UZ

PID2022-136454NB-C22

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2022
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE ZARAGOZA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Delegato: Locality-aware atomic memory operations on chiplets

  • Soria Pardos, Víctor
  • Armejach Sanosa, Adrià|||0000-0003-2869-668X
  • Mück, Tiago
  • Suárez Gracía, Dario
  • Joao, Jose A.
  • Moretó Planas, Miquel|||0000-0002-9848-8758
The irruption of chiplet-based architectures has been a game changer, enabling higher transistor integration and core counts in a single socket. However, chiplets impose higher and non-uniform memory access (NUMA) latencies than monolithic integration. This harms the efficiency of atomic memory operations (AMOs), which are fundamental to implementing fine-grained synchronization and concurrent data structures on large systems. AMOs are executed either near the core (near) or at a remote location within the cache hierarchy (far). On near AMOs, the core’s private cache fetches the target cache line in exclusiveness to modify it locally. Near AMOs cause significant data movement between private caches, especially harming parallel applications’ performance on chiplet-based architectures. Alternatively, far AMOs can alleviate the communication overhead by reducing data movement between processing elements. However, current multicore architectures only support one type of far AMO, which sends all updates to a single serialization point (centralized AMOs). This work introduces two new types of far AMOs, delegated and migrating, that execute AMOs remotely without centralizing updates in a single point of the cache hierarchy. Combining centralized, delegated, and migrating AMOs allows the directory to select the best location to execute AMOs. Moreover, we propose Delegato, a tracing optimization to effectively transport usage information from private caches to the directory to predict the best atomic type to issue accurately. Additionally, we design a simple predictor on top of Delegato that seamlessly selects the best placement to perform AMOs based on the data access pattern and usage activity of cores. Our evaluation using gem5 shows that Delegato can speed up applications on average by 1.07 × over centralized AMOs and by 1.13 × over the state-of-the-art AMO predictor., This research was supported by the Spanish Ministry of Science and Innovation through contracts [PID2023-146511NB-I00], and [PID2022-136454NB-C22] and by the Ministry for Digital Transformation and Public Service, within the framework of the Recovery, Transformation and Resilience Plan- NextGenerationEU [REGAGE22e00058408992]; the Generalitat of Catalunya through contract [2021-SGR-00763]; the Government of Aragón [T58_23R]; the Arm-BSC Center of Excellence, and the European Processor Initiative (EPI) which is part of the European Union’s Horizon 2020 research and innovation program under grant agreement No. 800928 and No. 101036168. V. Soria-Pardos has been supported through an FPU fellowship [FPU20-02132]; A. Armejach is a Serra Hunter Fellow., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Squire: A general-purpose accelerator to exploit fine-grain parallelism on dependency-bound kernels

  • Langarita Benítez, Rubén|||0000-0002-6080-724X
  • Alastruey Benedé, Jesús
  • Ibáñez Marín, Pablo
  • Marco Sola, Santiago|||0000-0001-7951-3914
  • Moretó Planas, Miquel|||0000-0002-9848-8758
  • Armejach Sanosa, Adrià|||0000-0003-2869-668X
Multiple HPC applications are often bottlenecked by compute-intensive kernels implementing complex dependency patterns (data-dependency bound). Traditional general-purpose accelerators struggle to effectively exploit fine-grain parallelism due to limitations in implementing convoluted data-dependency patterns (like SIMD) and overheads due to synchronization and data transfers (like GPGPUs). In contrast, custom FPGA and ASIC designs offer improved performance and energy efficiency at a high cost in hardware design and programming complexity and often lack the flexibility to process different workloads. We propose Squire, a general-purpose accelerator designed to exploit fine-grain parallelism effectively on dependency-bound kernels. Each Squire accelerator has a set of general-purpose low-power in-order cores that can rapidly communicate among themselves and directly access data from the L2 cache. Our proposal integrates one Squire accelerator per core in a typical multicore system, allowing the acceleration of dependency-bound kernels within parallel tasks with minimal software changes. As a case study, we evaluate Squire’s effectiveness by accelerating five kernels that implement complex dependency patterns. We use three of these kernels to build an end-to-end read-mapping tool that will be used to evaluate Squire. Squire obtains speedups up to 7.64× in dynamic programming kernels. Overall, Squire provides an acceleration for an end-to-end application of 3.66×. In addition, Squire reduces energy consumption by up to 56% with a minimal area overhead of 10.5% compared to a NeoverseN1 baseline., This research was supported by MICIU/AEI/10.13039/501100011033 and by ”ERDF A way of making Europe” through contracts [PID2023-146511NB-I00], [PID2023-146193OB-I00], and [PID2022-136454NBC22]; by the Ministry for Digital Transformation and Public Service, (i) via the framework of the Recovery, Transformation and Resilience Plan - NextGenerationEU [REGAGE22e00058408992] and (ii) through the Càtedra Chip UPC project [grant number TSI-069100-2023-0015]; by the Generalitat of Catalunya through contract [2021-SGR-00763]; by the Arm-BSC Center of Excellence; by the Lenovo-BSC Framework Contract (2020); and by Government of Aragón (T58 23R research group). A. Armejach is a Serra Hunter Fellow., Peer Reviewed
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Contribución de congreso (ConferenceOutput)

Squire: a general-purpose accelerator to exploit fine-grain parallelism on dependency-bound kernels

  • Langarita, Rubén
  • Alastruey-Benedé, Jesús
  • Ibáñez-Marín, Pablo
  • Marco-Sola, Santiago
  • Moretó, Miquel
  • Armejach, Adrià
Multiple HPC applications are often bottlenecked by compute-intensive kernels implementing complex dependency patterns (data-dependency bound). Traditional general-purpose accelerators struggle to effectively exploit fine-grain parallelism due to limitations in implementing convoluted data-dependency patterns (like SIMD) and overheads due to synchronization and data transfers (like GPGPUs). In contrast, custom FPGA and ASIC designs offer improved performance and energy efficiency at a high cost in hardware design and programming complexity and often lack the flexibility to process different workloads. We propose Squire, a general-purpose accelerator designed to exploit fine-grain parallelism effectively on dependency-bound kernels. Each Squire accelerator has a set of general-purpose low-power in-order cores that can rapidly communicate among themselves and directly access data from the L2 cache. Our proposal integrates one Squire accelerator per core in a typical multicore system, allowing the acceleration of dependency-bound kernels within parallel tasks with minimal software changes. As a case study, we evaluate Squire’s effectiveness by accelerating five kernels that implement complex dependency patterns. We use three of these kernels to build an end-to-end read-mapping tool that will be used to evaluate Squire. Squire obtains speedups up to 7.64× in dynamic programming kernels. Overall, Squire provides an acceleration for an end-to-end application of 3.66×. In addition, Squire reduces energy consumption by up to 56% with a minimal area overhead of 10.5% compared to a NeoverseN1 baseline.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Delegato: Locality-aware atomic memory operations on chiplets

  • Soria Pardos, Víctor
  • Armejach Sanosa, Adrià
  • Mück, Tiago
  • Suárez Gracía, Dario
  • Joao, Jose A.
  • Moretó Planas, Miquel
The irruption of chiplet-based architectures has been a game changer, enabling higher transistor integration and core counts in a single socket. However, chiplets impose higher and non-uniform memory access (NUMA) latencies than monolithic integration. This harms the efficiency of atomic memory operations (AMOs), which are fundamental to implementing fine-grained synchronization and concurrent data structures on large systems. AMOs are executed either near the core (near) or at a remote location within the cache hierarchy (far). On near AMOs, the core’s private cache fetches the target cache line in exclusiveness to modify it locally. Near AMOs cause significant data movement between private caches, especially harming parallel applications’ performance on chiplet-based architectures. Alternatively, far AMOs can alleviate the communication overhead by reducing data movement between processing elements. However, current multicore architectures only support one type of far AMO, which sends all updates to a single serialization point (centralized AMOs). This work introduces two new types of far AMOs, delegated and migrating, that execute AMOs remotely without centralizing updates in a single point of the cache hierarchy. Combining centralized, delegated, and migrating AMOs allows the directory to select the best location to execute AMOs. Moreover, we propose Delegato, a tracing optimization to effectively transport usage information from private caches to the directory to predict the best atomic type to issue accurately. Additionally, we design a simple predictor on top of Delegato that seamlessly selects the best placement to perform AMOs based on the data access pattern and usage activity of cores. Our evaluation using gem5 shows that Delegato can speed up applications on average by 1.07 × over centralized AMOs and by 1.13 × over the state-of-the-art AMO predictor., This research was supported by the Spanish Ministry of Science and Innovation through contracts [PID2023-146511NB-I00], and [PID2022-136454NB-C22] and by the Ministry for Digital Transformation and Public Service, within the framework of the Recovery, Transformation and Resilience Plan- NextGenerationEU [REGAGE22e00058408992]; the Generalitat of Catalunya through contract [2021-SGR-00763]; the Government of Aragón [T58_23R]; the Arm-BSC Center of Excellence, and the European Processor Initiative (EPI) which is part of the European Union’s Horizon 2020 research and innovation program under grant agreement No. 800928 and No. 101036168. V. Soria-Pardos has been supported through an FPU fellowship [FPU20-02132]; A. Armejach is a Serra Hunter Fellow., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Squire: A general-purpose accelerator to exploit fine-grain parallelism on dependency-bound kernels

  • Langarita Benítez, Rubén
  • Alastruey Benedé, Jesús
  • Ibáñez Marín, Pablo
  • Marco Sola, Santiago
  • Moretó Planas, Miquel
  • Armejach Sanosa, Adrià
Multiple HPC applications are often bottlenecked by compute-intensive kernels implementing complex dependency patterns (data-dependency bound). Traditional general-purpose accelerators struggle to effectively exploit fine-grain parallelism due to limitations in implementing convoluted data-dependency patterns (like SIMD) and overheads due to synchronization and data transfers (like GPGPUs). In contrast, custom FPGA and ASIC designs offer improved performance and energy efficiency at a high cost in hardware design and programming complexity and often lack the flexibility to process different workloads. We propose Squire, a general-purpose accelerator designed to exploit fine-grain parallelism effectively on dependency-bound kernels. Each Squire accelerator has a set of general-purpose low-power in-order cores that can rapidly communicate among themselves and directly access data from the L2 cache. Our proposal integrates one Squire accelerator per core in a typical multicore system, allowing the acceleration of dependency-bound kernels within parallel tasks with minimal software changes. As a case study, we evaluate Squire’s effectiveness by accelerating five kernels that implement complex dependency patterns. We use three of these kernels to build an end-to-end read-mapping tool that will be used to evaluate Squire. Squire obtains speedups up to 7.64× in dynamic programming kernels. Overall, Squire provides an acceleration for an end-to-end application of 3.66×. In addition, Squire reduces energy consumption by up to 56% with a minimal area overhead of 10.5% compared to a NeoverseN1 baseline., This research was supported by MICIU/AEI/10.13039/501100011033 and by ”ERDF A way of making Europe” through contracts [PID2023-146511NB-I00], [PID2023-146193OB-I00], and [PID2022-136454NBC22]; by the Ministry for Digital Transformation and Public Service, (i) via the framework of the Recovery, Transformation and Resilience Plan - NextGenerationEU [REGAGE22e00058408992] and (ii) through the Càtedra Chip UPC project [grant number TSI-069100-2023-0015]; by the Generalitat of Catalunya through contract [2021-SGR-00763]; by the Arm-BSC Center of Excellence; by the Lenovo-BSC Framework Contract (2020); and by Government of Aragón (T58 23R research group). A. Armejach is a Serra Hunter Fellow., Peer Reviewed, Postprint (author's final draft)