Skip to main content

COMPUTACION Y COMUNICACIONES DE ALTAS PRESTACIONES CONSCIENTE DEL CONSUMO ENERGETICO. APLICACIONES AL APRENDIZAJE PROFUNDO COMPUTACIONAL - UJI

PID2020-113656RB-C21

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2020
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSITAT JAUME I DE CASTELLO

Resultados relacionados

Resultados totales (Incluyendo duplicados): 2
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Efficient data redistribution for malleable applications

  • Martínez Alvarez, Iker
  • Aliaga, José I
  • Castrillo, Maribel
  • Iserte, Sergio
Process malleability can be defined as the ability of a distributed MPI parallel job to change the number of processes on–the–fly without stopping its execution, reallocating the compute resources originally assigned to the job, and without storing application data to disk. MPI malleability consists of four stages: resource reallocation, process management, data redistribution and execution resuming. Among them, data redistribution is the most time-consuming and determines the reconfiguration time. In this paper, we compare different implementations of this stage using point-to-point and collective MPI operations, and discuss the impact of overlapping computation-communication. We then combine these strategies with different methods to expand/shrink jobs, using a synthetic application to emulate MPI-based codes and their malleable counterparts, in order to evaluate the effect of different malleability methods in parallel distributed applications. The results show that the use of asynchronous techniques speeds up execution by 1.14 and 1.21, depending on the network used., This work has been funded by project PID2020-113656RB-C21 supported by MCIN/AEI/10.13039/501100011033. Researcher I. MartínÁlvarez was supported by the predoctoral fellowship ACIF/2021/260 from Valencian Region Government and European Social Funds. The European DEEP-SEA project has received funding from the European Commission’s EuroHPC-JU program under grant agreement No 955606, the JU receives support from the European Union’s Horizon 2020 research and innovation programme and by the Spanish Ministry under Grant PCI2021-121958 funded by MCIN / AEI /10.13039 / 501100011033 and by the “European Union NextGenerationEU/PRTR”., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Efficient data redistribution for malleable applications

  • Martínez Alvarez, Iker
  • Aliaga, José I
  • Castrillo, Maribel
  • Iserte, Sergio
Process malleability can be defined as the ability of a distributed MPI parallel job to change the number of processes on–the–fly without stopping its execution, reallocating the compute resources originally assigned to the job, and without storing application data to disk. MPI malleability consists of four stages: resource reallocation, process management, data redistribution and execution resuming. Among them, data redistribution is the most time-consuming and determines the reconfiguration time. In this paper, we compare different implementations of this stage using point-to-point and collective MPI operations, and discuss the impact of overlapping computation-communication. We then combine these strategies with different methods to expand/shrink jobs, using a synthetic application to emulate MPI-based codes and their malleable counterparts, in order to evaluate the effect of different malleability methods in parallel distributed applications. The results show that the use of asynchronous techniques speeds up execution by 1.14 and 1.21, depending on the network used., This work has been funded by project PID2020-113656RB-C21 supported by MCIN/AEI/10.13039/501100011033. Researcher I. MartínÁlvarez was supported by the predoctoral fellowship ACIF/2021/260 from Valencian Region Government and European Social Funds. The European DEEP-SEA project has received funding from the European Commission’s EuroHPC-JU program under grant agreement No 955606, the JU receives support from the European Union’s Horizon 2020 research and innovation programme and by the Spanish Ministry under Grant PCI2021-121958 funded by MCIN / AEI /10.13039 / 501100011033 and by the “European Union NextGenerationEU/PRTR”., Peer Reviewed, Postprint (published version)