RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Contribución de congreso (ConferenceOutput)
CELLO: Compiler-Assisted Efficient Load-Load Ordering in Data-Race-Free Regions
[EN] Efficient Total Store Order (TSO) implementations allow loads to execute speculatively out-of-order. To detect order violations, the load queue (LQ) holds all the in-flight loads and is searched on every invalidation and cache eviction. Moreover, in a simultaneous multithreading processor (SMT), stores also search the LQ when writing to cache. LQ searches entail considerable energy consumption. Furthermore, the processor stalls upon encountering the LQ full or when its ports are busy. Hence, the LQ is a critical structure in terms of both energy and
performance.
In this work, we observe that the use of the LQ could be dramatically optimized under the guarantees of the datarace-free (DRF) property imposed by modern programming languages. To leverage this observation, we propose CELLO, a software-hardware co-design in which the compiler detects memory operations in DRF regions and the hardware optimizes their execution by safely skipping LQ searches without violating the TSO consistency model. Furthermore, CELLO allows removing DRF loads from the LQ earlier, as they do not need to be searched to detect consistency violations.
With minimal hardware overhead, we show that an 8-core 2-way SMT processor with CELLO avoids almost all conservative searches to the LQ and significantly reduces its occupancy. CELLO allows i) to reduce the LQ energy expenditure by 33% on average (up to 53%) while performing 2.8% better on average (up to 18.6%) than the baseline system, and ii) to shrink the LQ size from 192 to only 80 entries, reducing the LQ energy expenditure as much as 69% while performing on par with a mainstream LQ implementation., This project has received funding from the European
Research Council (ERC) under the European Union s Horizon
2020 research and innovation program (grant agreement No
819134), from the MCIN/AEI/10.13039/501100011033/ and
the ERDF A way of making Europe , EU (grant PID2022-
136315OB-I00), from the European Union s Horizon
2021 research and innovation program (grant agreement
No 101070374 under HORIZON-CL4-2021-DIGITALEMERGING-01) and RYC2018-025200-I, and from the
MCIN/AEI/10.13039/501100011033/ and the European
Union NextGenerationEU/PRTR (grants TED2021-130233BC33/C32 and RYC2021-030862-I).
Proyecto:
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 PID2022-136315OB-I00
,
European Commission / H2020 819134
,
European Commission / HE 101070374
,
Agencia Estatal de Investigación RYC2021-030862-I
,
European Research Council TED2021-130233B-C32
,
Agencia Estatal de Investigación 819134
,
RYC2018-025200-I