RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication
Contribución de congreso (ConferenceOutput)
Anatomy of the BLIS family of algorithms for matrix multiplication
[EN] The efforts of the scientific community and hardware vendors to develop and optimize linear algebra codes have historically led to highly-tuned libraries, carefully adapted to the underlying processor architecture, with excellent (near-peak) performance. These optimization efforts, however, are commonly focused on obtaining the best performance possible when the involved operands are large and "squarish" matrices. New computationally-intensive applications (e.g., in deep learning) are increasingly demanding high-performance BLAS (Basic Linear Algebra Subprograms) also for small operands in any of their dimensions. In this paper, we tackle this problem by refactoring the general matrix-matrix multiplication (GEMM) algorithm within a specific high-performance implementation of BLAS, named BLIS, proposing a complete family of algorithmic variants to implement GEMM with different strategies to exploit the target cache hierarchy, together with the changes to be applied to architecture-specific codes to instantiate a complete GEMM implementation. Experimental results on an ARM processor (NVIDIA Carmel) reveal significant performance differences between the members of the GEMM family, depending on the shape and dimension of the matrix operands., This work was supported by the research project PID2020-113656RB-C22 of MCIN/AEI/10.13039/501100011033, EU (FEDER), the Spanish MINECO, under grants RTI2018-093684-B-I00, PID2021-126576NB-I00, and CM via Multiannual Agreement with Complutense University in the line Program to Stimulate Research for Young Doctors in the context of the V PRICIT under projects PR65/19-22445 and CM S2018/TCS-4423. A. Castello is a FJC2019-039222-I fellow supported by MCIN/AEI/10.13039/501100011033.
Project:
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 PID2020-113656RB-C22
,
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 RTI2018-093684-B-I00
,
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 PID2021-126576NB-I00
,
Caja de Ahorros del Mediterráneo PR65/19-22445
,
Caja de Ahorros del Mediterráneo S2018/TCS-4423
,
Ministerio de Ciencia FJC2019-039222-I