Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Managing Workflows on top of a Cloud Computing Orchestrator for using heterogeneous environments on e-Science

  • Carrión Collado, Abel Antonio
  • Kotowski, Nelson
  • Jardim, Rodrigo
  • Dávila, Alberto M. R.
  • Caballer Fernández, Miguel|||0000-0001-9393-3077
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
[EN] Scientific workflows (SWFs) are widely used to model processes in e-Science. SWFs are executed by means of workflow management systems (WMSs), which orchestrate the workload on top of computing infrastructures. The advent of cloud computing infrastructures has opened the door of using on-demand infrastructures to complement or even replace local infrastructures. However, new issues have arisen, such as the integration of hybrid resources or the compromise between infrastructure reutilisation and elasticity. In this article, we present an ad hoc solution for managing workflows exploiting the capabilities of cloud orchestrators to deploy resources on demand according to the workload and to combine heterogeneous cloud providers (such as on-premise clouds and public clouds) and traditional infrastructures (clusters) to minimise costs and response time. The work does not propose yet another WMS but demonstrates the benefits of the integration of cloud orchestration when running complex workflows. The article shows several configuration experiments from a realistic comparative genomics workflow called Orthosearch, to migrate memory-intensive workload to public infrastructures while keeping other blocks of the experiment running locally. The article computes running time and cost suggesting best practices., This paper wants to acknowledge the support of the EUBrazilCC project, funded by the European Commission (STREP 614048) and the Brazilian MCT/CNPq N. 13/2012, for the use of its infrastructure. The authors would like also to thank the Spanish 'Ministerio de Economia y Competitividad' for the project 'Clusters Virtuales Elasticos y Migrables sobre Infraestructuras Cloud Hibridas' with reference TIN2013-44390-R.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

BioClimate: a Science Gateway for Climate Change and Biodiversity research in the EUBrazilCloudConnect project

  • Fiore, Sandro
  • Elia, Donatello
  • Brasileiro, Francisco V.
  • Nuzzo, Alessandra
  • Nassisi, Paola
  • Rufino, Lana A. A.
  • Seijmonsbergen, Arie C.
  • Anders, Niels S.
  • Galvão, Carlos de O.
  • Cunha, John E. de B. L.
  • Baena, Mariane de Sousa
  • Canhos, Vanderlei P.
  • Aloisio, Giovanni
  • Blanquer Espert, Ignacio|||0000-0003-1692-8922
  • Caballer Fernández, Miguel|||0000-0001-9393-3077
[EN] Climate and biodiversity systems are closely linked across a wide range of scales. To better understand the mutual interaction between climate change and biodiversity there is a strong need for multidisciplinary skills, scientific tools, and access to a large variety of heterogeneous, often distributed, data sources. Related to that, the EUBrazilCloudConnect project provides a user-oriented research environment built on top of a federated cloud infrastructure across Europe and Brazil, to serve key needs in different scientific domains, which is validated through a set of use cases. Among them, the most data-centric one is focused on climate change and biodiversity research. As part of this use case, the BioClimate Science Gateway has been implemented to provide end-users transparent access to (i) a highly integrated user-friendly environment, (ii) a large variety of data sources, and (iii) different analytics & visualization tools to serve a large spectrum of users needs and requirements. This paper presents a complete overview of BioClimate and the related scientific environment, in particular its Science Gateway, delivered to the end-user community at the end of the project., This work was supported by the EU FP7 EUBrazilCloudConnect Project (Grant Agreement 614048), and CNPq/Brazil (Grant Agreement no 490115/2013-6).
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

HPC compact quasi-Newton algorithm for interface problems

  • Santiago, Alfonso|||0000-0002-9374-1275
  • Zavala Aké, Miguel
  • Borrell Pol, Ricard
  • Houzeaux, Guillaume|||0000-0002-2592-1426
  • Vázquez, Mariano|||0000-0002-2526-6708
In this work we present a robust interface coupling algorithm called Compact Interface quasi-Newton (CIQN). It is designed for computationally intensive applications using an MPI multi-code partitioned scheme. The algorithm allows to reuse information from previous time steps, feature that has been previously proposed to accelerate convergence. Through algebraic manipulation, an efficient usage of the computational resources is achieved by: avoiding construction of dense matrices and reduce every multiplication to a matrix–vector product and reusing the computationally expensive loops. This leads to a compact version of the original quasi-Newton algorithm. Altogether with an efficient communication, in this paper we show an efficient scalability up to 4800 cores. Three examples with qualitatively different dynamics are shown to prove that the algorithm can efficiently deal with added mass instability and two-field coupled problems. We also show how reusing histories and filtering does not necessarily makes a more robust scheme and, finally, we prove the necessity of this HPC version of the algorithm. The novelty of this article lies in the HPC focused implementation of the algorithm, detailing how to fuse and combine the composing blocks to obtain an scalable MPI implementation. Such an implementation is mandatory in large scale cases, for which the contact surface cannot be stored in a single computational node, or the number of contact nodes is not negligible compared with the size of the domain., This work has been funded by CompBioMed project a grant by the EuropeanCommission H2020 (agreement nr: 823712), EUBrazilCC a project under the Programme FP7-ICT (agreement nr: 614048) and a FPI-SO grant (agreementnr: SVP-2014-068491, Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

HPC compact quasi-Newton algorithm for interface problems

  • Santiago, Alfonso
  • Zavala Aké, Miguel
  • Borrell Pol, Ricard
  • Houzeaux, Guillaume
  • Vázquez, Mariano
In this work we present a robust interface coupling algorithm called Compact Interface quasi-Newton (CIQN). It is designed for computationally intensive applications using an MPI multi-code partitioned scheme. The algorithm allows to reuse information from previous time steps, feature that has been previously proposed to accelerate convergence. Through algebraic manipulation, an efficient usage of the computational resources is achieved by: avoiding construction of dense matrices and reduce every multiplication to a matrix–vector product and reusing the computationally expensive loops. This leads to a compact version of the original quasi-Newton algorithm. Altogether with an efficient communication, in this paper we show an efficient scalability up to 4800 cores. Three examples with qualitatively different dynamics are shown to prove that the algorithm can efficiently deal with added mass instability and two-field coupled problems. We also show how reusing histories and filtering does not necessarily makes a more robust scheme and, finally, we prove the necessity of this HPC version of the algorithm. The novelty of this article lies in the HPC focused implementation of the algorithm, detailing how to fuse and combine the composing blocks to obtain an scalable MPI implementation. Such an implementation is mandatory in large scale cases, for which the contact surface cannot be stored in a single computational node, or the number of contact nodes is not negligible compared with the size of the domain., This work has been funded by CompBioMed project a grant by the EuropeanCommission H2020 (agreement nr: 823712), EUBrazilCC a project under the Programme FP7-ICT (agreement nr: 614048) and a FPI-SO grant (agreementnr: SVP-2014-068491, Peer Reviewed, Postprint (author's final draft)