Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Communication characterization of AI workloads for large-scale multi-chiplet accelerators

  • Musavi, Mariam
  • Irabor, Emmanuel Onyekachukw
  • Das, Abhijit
  • Alarcón Cot, Eduardo José|||0000-0001-7663-7153
  • Abadal Cavallé, Sergi|||0000-0003-0941-0260
Next-generation artificial intelligence (AI) workloads are posing challenges of scalability and robustness in terms of execution time due to their intrinsic evolving data-intensive characteristics. In this paper, we aim to analyse the potential bottlenecks caused due to data movement characteristics of AI workloads on scale-out accelerator architectures composed of multiple chiplets. Our methodology captures the unicast and multicast communication traffic of a set of AI workloads and assesses aspects such as the time spent in such communications and the amount of multicast messages as a function of the number of employed chiplets. Our studies reveal that some AI workloads are potentially vulnerable to the dominant effects of communication, especially multicast traffic, which can become a performance bottleneck and limit their scalability. Workload profiling insights suggest to architect a flexible interconnect solution at chiplet level in order to improve the performance, efficiency and scalability of next-generation AI accelerators., Authors gratefully acknowledge funding from the European Commission through projects with GA 101042080 (WINC) and 101189474 (EWiC) and from Generalitat de Catalunya through the ICREA Academia Award 2024., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Exploring the potential of wireless-enabled multi-chip AI accelerators

  • Irabor, Emmanuel Onyekachukw
  • Musavi, Mariam
  • Das, Abhijit
  • Abadal Cavallé, Sergi|||0000-0003-0941-0260
The insatiable appetite of Artificial Intelligence (AI) workloads for computing power is pushing the industry to develop faster and more efficient accelerators. The rigidity of custom hardware, however, conflicts with the need for scalable and versatile architectures capable of catering to the needs of the evolving and heterogeneous pool of Machine Learning (ML) models in the literature. In this context, multi-chiplet architectures assembling multiple (perhaps heterogeneous) accelerators are an appealing option that is unfortunately hindered by the still rigid and inefficient chip-to-chip interconnects. In this paper, we explore the potential of wireless technology as a complement to existing wired interconnects in this multi-chiplet approach. Using an evaluation framework from the state-of-the-art, we show that wireless interconnects can lead to speedups of 10% on average and 20% maximum. We also highlight the importance of load balancing between the wired and wireless interconnects, which will be further explored in future work., Authors gratefully acknowledge funding from the European Commission through projects with GA 101042080 (WINC) and 101189474 (EWiC)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Communication characterization of AI workloads for large-scale multi-chiplet accelerators

  • Musavi, Mariam
  • Irabor, Emmanuel Onyekachukw
  • Das, Abhijit
  • Alarcón Cot, Eduardo José
  • Abadal Cavallé, Sergi
Next-generation artificial intelligence (AI) workloads are posing challenges of scalability and robustness in terms of execution time due to their intrinsic evolving data-intensive characteristics. In this paper, we aim to analyse the potential bottlenecks caused due to data movement characteristics of AI workloads on scale-out accelerator architectures composed of multiple chiplets. Our methodology captures the unicast and multicast communication traffic of a set of AI workloads and assesses aspects such as the time spent in such communications and the amount of multicast messages as a function of the number of employed chiplets. Our studies reveal that some AI workloads are potentially vulnerable to the dominant effects of communication, especially multicast traffic, which can become a performance bottleneck and limit their scalability. Workload profiling insights suggest to architect a flexible interconnect solution at chiplet level in order to improve the performance, efficiency and scalability of next-generation AI accelerators., Authors gratefully acknowledge funding from the European Commission through projects with GA 101042080 (WINC) and 101189474 (EWiC) and from Generalitat de Catalunya through the ICREA Academia Award 2024., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Exploring the potential of wireless-enabled multi-chip AI accelerators

  • Irabor, Emmanuel Onyekachukw
  • Musavi, Mariam
  • Das, Abhijit
  • Abadal Cavallé, Sergi
The insatiable appetite of Artificial Intelligence (AI) workloads for computing power is pushing the industry to develop faster and more efficient accelerators. The rigidity of custom hardware, however, conflicts with the need for scalable and versatile architectures capable of catering to the needs of the evolving and heterogeneous pool of Machine Learning (ML) models in the literature. In this context, multi-chiplet architectures assembling multiple (perhaps heterogeneous) accelerators are an appealing option that is unfortunately hindered by the still rigid and inefficient chip-to-chip interconnects. In this paper, we explore the potential of wireless technology as a complement to existing wired interconnects in this multi-chiplet approach. Using an evaluation framework from the state-of-the-art, we show that wireless interconnects can lead to speedups of 10% on average and 20% maximum. We also highlight the importance of load balancing between the wired and wireless interconnects, which will be further explored in future work., Authors gratefully acknowledge funding from the European Commission through projects with GA 101042080 (WINC) and 101189474 (EWiC)., Peer Reviewed, Postprint (published version)