Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 60
Encontrada(s) 1 página(s)

UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D4.2 Profiling report of the partner’s tools, complete with performance suggestions

  • Amela Milian, Ramon
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Böhm, Stanislav
  • Tosi, Riccardo|||0000-0002-0133-8367
  • Rossi, Riccardo|||0000-0003-0528-7074
This deliverable focuses on the proling activities developed in the project with the partner's applications. To perform this proling activities, a couple of benchmarks were dened in collaboration with WP5. The rst benchmark is an embarrassingly parallel benchmark that performs a read and then multiple writes of the same object, with the objective of stressing the memory and storage systems and evaluate the overhead when these reads and writes are performed in parallel. A second benchmark is dened based on the Continuation Multi Level Monte Carlo (C-MLMC) algorithm. While this algorithm is normally executed using multiple levels, for the proling and performance analysis objectives, the execution of a single level was enough since the forthcoming levels have similar performance characteristics. Additionally, while the simulation tasks can be executed as parallel (multi-threaded tasks), in the benchmark, single threaded tasks were executed to increase the number of simulations to be scheduled and stress the scheduling engines. A set of experiments based on these two benchmarks have been executed in the MareNostrum 4 supercomputer and using PyCOMPSs as underlying programming model and dynamic scheduler of the tasks involved in the executions. While the rst benchmark was executed several times in a single iteration, the second benchmark was executed in an iterative manner, with cycles of 1) Execution and trace generation; 2) Performance analysis; 3) Improvements. This had enabled to perform several improvements in the benchmark and in the scheduler of PyCOMPSs. The initial iterations focused on the C-MLMC structure itself, performing re-factors of the code to remove ne grain and sequential tasks and merging them in larger granularity tasks. The next iterations focused on improving the PyCOMPSs scheduler, removing existent bottlenecks and increasing its performance by making the scheduler a multithreaded engine. While the results can still be improved, we are satised with the results since the granularity of the simulations run in this evaluation step are much ner than the one that will be used for the real scenarios. The deliverable nishes with some recommendations that should be followed along the project in order to obtain good performance in the execution of the project codes.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A generic finite element framework on parallel tree-based adaptive meshes

  • Badia, Santiago|||0000-0003-2391-4086
  • Martín, Alberto F.
  • Miranda Neiva, Eric|||0000-0002-1220-9624
  • Verdugo Rojano, Francesc|||0000-0003-3667-443X
In this work we formally derive and prove the correctness of the algorithms and data structures in a parallel, distributed-memory, generic finite element framework that supports h-adaptivity on computational domains represented as forest-of-trees. The framework is grounded on a rich representation of the adaptive mesh suitable for generic finite elements that is built on top of a low-level, light-weight forest-of-trees data structure handled by a specialized, highly parallel adaptive meshing engine, for which we have identified the requirements it must fulfill to be coupled into our framework. Atop this two-layered mesh representation, we build the rest of the data structures required for the numerical integration and assembly of the discrete system of linear equations. We consider algorithms that are suitable for both subassembled and fully assembled distributed data layouts of linear system matrices. The proposed framework has been implemented within the FEMPAR scientific software library, using p4est as a practical forest-of-octrees demonstrator. A strong scaling study of this implementation when applied to Poisson and Maxwell problems reveals remarkable scalability up to 32.2K CPU cores and 482.2M degrees of freedom. Besides, a comparative performance study of FEMPAR and the state-of-the-art deal.II finite element software shows at least comparative performance, and at most a factor of 2--3 improvement in the h-adaptive approximation of a Poisson problem with first- and second-order Lagrangian finite elements, respectively., Financial support from the European Commission under the EMUSIC and ExaQUteprojects within the Horizon 2020 Framework Programme is gratefully acknowledged (grants 690725and 800898, resp.). This work has been partially funded by the project RTI2018-096898-B-I00from the “FEDER/Ministerio de Ciencia e Innovación–Agencia Estatal de Investigación”. The firstauthor gratefully acknowledges the support received from the Catalan Government through theICREA Acadèmia Research Program. The third author gratefully acknowledges the support receivedfrom the Catalan Government through an FI fellowship (2019 FI-B2-00090; 2018 FI-B1-00095; 2017FI-B-00219). The fourth author gratefully acknowledges the support received from the Secretariad’Universitats i Recerca of the Catalan Government in the framework of the Beatriu Pinós Program(grant 2016 BP 00145). The authors thankfully acknowledge the computer resources at Marenostrum-IV and the technical support provided by the Barcelona Supercomputing Center (RES-ActivityID:FI-2018-2-0009, FI-2018-3-0029, IM-2020-1-0002)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Robust and scalable h-adaptive aggregated unfitted finite elements for interface elliptic problems

  • Miranda Neiva, Eric|||0000-0002-1220-9624
  • Badia, Santiago|||0000-0003-2391-4086
This work introduces a novel, fully robust and highly-scalable, -adaptive aggregated unfitted finite element method for large-scale interface elliptic problems. The new method is based on a recent distributed-memory implementation of the aggregated finite element method atop a highly-scalable Cartesian forest-of-trees mesh engine. It follows the classical approach of weakly coupling nonmatching discretisations at the interface to model internal discontinuities at the interface. We propose a natural extension of a single-domain parallel cell aggregation scheme to problems with a finite number of interfaces; it straightforwardly leads to aggregated finite element spaces that have the structure of a Cartesian product. We demonstrate, through standard numerical analysis and exhaustive numerical experimentation on several complex Poisson and linear elasticity benchmarks, that the new technique enjoys the following properties: well-posedness, robustness with respect to cut location and material contrast, optimal (h-adaptive) approximation properties, high scalability and easy implementation in large-scale finite element codes. As a result, the method offers great potential as a useful finite element solver for large-scale interface problems modelled by partial differential equations., Financial support from the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme is gratefully acknowledged. This work has been partially funded by the projects RTI2018-096898-B-I00 and ERC2018-092843 from the “Ministerio de Ciencia e Innovación” of Spain. E. Neiva gratefully acknowledges the support received from the Catalan Government, Spain through a FI fellowship (2019 FI-B2-00090; 2018 FI-B1-00095; 2017 FI-B-00219). S. Badia gratefully acknowledges the support received from the Catalan Government through the ICREA Acadèmia Research Program, Spain. The authors thankfully acknowledge the computer resources at Marenostrum-IV and the technical support provided by the Barcelona Supercomputing Center (RES-ActivityIDs: IM-2019-3-0008, IM-2020-1-0002). Financial support to CIMNE via the CERCA Programme/Generalitat de Catalunya, Spain is also acknowledged., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

An embedded approach for the solution of the full potential equation with finite elements

  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Lopez, Iñigo
  • Baiges Aznar, Joan|||0000-0002-3940-5887
  • Rossi, Riccardo|||0000-0003-0528-7074
Recent developments in numerical simulations in the aerodynamics field are focused on reducing the computational cost of the solvers, targeting their use at the initial design steps. Under the right assumptions, potential solvers can be exploited to accomplish a valid solution of the flow field for streamlined bodies in subsonic and close to transonic flows. A fully embedded approach to solve the full-potential equation is presented, where both the geometry and the wake are defined implicitly with a level set function. Embedded methods allow simplifying the mesh generation process, as only a background mesh is required to perform the analysis. The presented method gives an automatic and fast option to solve subsonic flows, which is especially desirable in optimization workflows., This work has been supported by the European Commission through the Horizon 2020 Research and Innovation program under contract 800898 (ExaQUte project). The authors also acknowledge financial support from the Spanish Ministry of Economy and Competitiveness , through the “Severo Ochoa Programme for Centres of Excellence in R&D” (CEX2018-000797-S)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A robust and scalable unfitted adaptive finite element framework for nonlinear solid mechanics

  • Badia, Santiago|||0000-0003-2391-4086
  • Caicedo Silva, Manuel Alejandro|||0000-0001-7300-799X
  • Martín, Alberto F.
  • Principe, Ricardo Javier|||0000-0002-1478-2651
In this work, we bridge standard Adaptive Mesh Refinement and coarsening (AMR) on scalable octree background meshes and robust unfitted Finite Element (FE) formulations for the automatic and efficient solution of large-scale nonlinear solid mechanics problems posed on complex geometries, as an alternative to standard body-fitted formulations, unstructured mesh generation and graph partitioning strategies. We pay special attention to those aspects requiring a specialized treatment in the extension of the unfitted -adaptive Aggregated Finite Element Method (-AgFEM) on parallel tree-based adaptive meshes, recently developed for linear scalar elliptic problems, to handle nonlinear problems in solid mechanics. In order to accurately and efficiently capture localized phenomena that frequently occur in nonlinear solid mechanics problems, we perform pseudo time-stepping in combination with -adaptive dynamic mesh refinement and re-balancing driven by a-posteriori error estimators. The method is implemented considering both irreducible and mixed (u/p) formulations and thus it is able to robustly face problems involving incompressible materials. In the numerical experiments, both formulations are used to model the inelastic behavior of a wide range of compressible and incompressible materials. First, a selected set of benchmarks is reproduced as a verification step. Second, a set of experiments is presented with problems involving complex geometries. Among them, we model a cantilever beam problem with spherical hollows distributed in a simple cubic (SC) array. This test involves a discrete domain with up to 11.7M Degrees Of Freedom (DOFs) solved in less than two hours on 3072 cores of a parallel supercomputer., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A time averaged steady state method for the Navier-Stokes equations

  • Zhao, Mengjie
  • Zorrilla Martínez, Rubén|||0000-0001-8270-7170
  • Rossi, Riccardo|||0000-0003-0528-7074
  • Wüchner, Roland
This work derives an incompressible Variational Multiscales time-averaged Navier-Stokes formulation that aims at obtaining accurate steady state solutions. Rather than using the standard time instantaneous velocity and pressure, the new formulation devises a time averaging procedure based on rewriting and solving the Navier-Stokes equations in terms of the newly defined time-averaged velocity and pressure. Hence, the method could be understood as a convenient change of variable so that the problem is rewritten directly in terms of the steady state quantities. The important advantage of such a point of view is that it can in principle be applied to any other formulation. Such time averaging procedure is complemented by two time step modification strategies in order to accelerate the convergence to the steady state. The guidelines of an integrated framework are presented in the paper, starting with the description of the proposed numerical technique applied to general incompressible flows. The explanation is enhanced with a 1D non-linear oscillator example. Several results are presented concerning analytical benchmarks, simulation of flows in laminar, transitional and turbulent regimes with and without an inherently steady solution., This research has been partly supported by the International Graduate School of Science and Engineering (IGSSE) and the European Commission (EC) through the projects ATMOPACE and ExaQUte (H2020FETHPC-2016-2017-800898). Rubén Zorrilla gratefully acknowledges the support of the Spanish Government for his FPU Grant (FPU15/03796)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Performance meets programmabilty: Enabling native Python MPI tasks in PyCOMPSs

  • Elshazly, Hatem Mohamed Abdelfattah Eid|||0000-0002-8591-1502
  • Lordan Gomis, Francesc|||0000-0002-9845-8890
  • Ejarque Artigas, Jorge
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
©2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The increasing complexity of modern and future computing systems makes it challenging to develop applications that aim for maximum performance. Hybrid parallel programming models offer new ways to exploit the capabilities of the underlying infrastructure. However, the performance gain is sometimes accompanied by increased programming complexity. We introduce an extension to PyCOMPSs, a high-level task-based parallel programming model for Python applications, to support tasks that use MPI natively as part of the task model. Without compromising application's programmability, using Native MPI tasks in PyCOMPSs offers up to 3x improvement in total performance for compute intensive applications and up to 1.9x improvement in total performance for I/O intensive applications over sequential implementation of the tasks., This work is partially supported by the European Union through the Horizon 2020 research and innovation programme under contracts 721865 (EXPERTISE Project) and 800898 (ExaQUte project), by the Spanish Government (TIN2015- 65316-P) and the Generalitat de Catalunya (contract 2014- SGR-1051)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D5.4 Report on MLMC for time dependent problems

  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Tosi, Riccardo|||0000-0002-0133-8367
  • Nobile, Fabio
  • Rossi, Riccardo|||0000-0003-0528-7074
In this report, we study the use of Multi-Level Monte Carlo (MLMC) methods for time dependent problems. It was found that the usability of MLMC methods depends strongly on whether or not the underlying time dependent problem is chaotic in nature. Numerical experiments are conducted on both simple problems, as well as fluid flow problems of practical interest to the ExaQUte project, to demonstrate this. For the non-chaotic cases, the hypotheses that enable the use of MLMC methods were found to be satisfied. For the chaotic cases, especially the case of high Reynolds’ number fluid flow, the hypotheses were not satisfied. However, it was found that correlations between the different levels were high enough to merit the use of multi-fidelity or control-variate approaches. It was also noted that MLMC methods could work for chaotic problems if the time window of analysis were chosen to be small enough. Future studies are proposed to examine this possibility.
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D2.3. Adjoint-based error estimation routines

  • Keith, Brendan
  • Apostolatos, Andreas
  • Kodakkal, Anoop
  • Rossi, Riccardo|||0000-0003-0528-7074
  • Tosi, Riccardo|||0000-0002-0133-8367
  • Wohlmuth, Barbara
This document presents a simple and ecient strategy for adaptive mesh refinement (AMR) and a posteriori error estimation for the transient incompressible Navier{Stokes equations. This strategy is informed by the work of Prudhomme and Oden [22, 23] as well as modern goal-oriented methods such as [5]. The methods described in this document have been implemented in the Kratos Multiphysics software and uploaded to https://zenodo.org [27].1 This document includes: A review of the state-of-the-art in solution-oriented and goal-oriented AMR. The description of a 2D benchmark model problem of immediate relevance to the objectives of the ExaQUte project. The definition and a brief mathematical summary of the error estimator(s). The results obtained. A description of the API.
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D5.2 Release of ExaQUte MLMC Python engine

  • Amela Milian, Ramon
  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Tosi, Riccardo|||0000-0002-0133-8367
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Nobile, Fabio
  • Rossi, Riccardo|||0000-0003-0528-7074
In this deliverable, the ExaQUte xmc library is introduced. This report is meant to serve as a supplement to the publicly release of the library. In the following sections, the ExaQUte xmc library is described along with its current and future capabilities. The structure of the library, along with its dynamic import mechanism, are described using samples of code. The algorithms behind the example files supplied with the public release are explained in detail as well.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

An embedded Finite Element framework for the resolution of strongly coupled Fluid–Structure Interaction problems: application to volumetric and membrane-like structures

  • Zorrilla Martínez, Rubén|||0000-0001-8270-7170
  • Rossi, Riccardo|||0000-0003-0528-7074
  • Wüchner, Roland
  • Oñate Ibáñez de Navarra, Eugenio|||0000-0002-0804-7095
This work presents a Fluid–Structure Interaction framework for the robust and efficient simulation of strongly coupled problems involving arbitrary large displacements and rotations. We focus on the application of the proposed tool to lightweight membrane-like structures. Nonetheless, all the techniques we present in this work can be applied to both volumetric and volumeless bodies. To achieve this, we rely on the use of embedded mesh methods in the fluid solver to conveniently handle the extremely large deflections and eventual topology changes of the structure. The coupling between the embedded fluid and mechanical solvers is based on an interface residual black-box strategy. We validate our proposal by solving reference benchmarking examples that consider both volumetric and volumeless geometries. Whenever it is possible, we also compare the embedded solution with the one obtained with our reference body fitted solver. Finally we present a real-life application of the presented embedded Fluid–Structure Interaction solver., This research has been partly supported by the International Graduate School of Science and Engineering, Germany (IGSSE) and the European Commission (EC) through the projects ATMOPACE and ExaQUte (H2020-FETHPC-2016-2017-800898). The authors also acknowledge financial support from the Spanish Ministry of Economy and Competitiveness , through the “Severo Ochoa Programme for Centres of Excellence in R&D” (CEX2018-000797-S). Rubén Zorrilla gratefully acknowledges the support of the Spanish ministry of Science, Innovation and Universities for his FPU grant (FPU15/03796)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Robust high-order unfitted finite elements by interpolation-based discrete extension

  • Badia, Santiago|||0000-0003-2391-4086
  • Miranda Neiva, Eric|||0000-0002-1220-9624
  • Verdugo Rojano, Francesc|||0000-0003-3667-443X
In this work, we propose a novel formulation for the solution of partial differential equations using finite element methods on unfitted meshes. The proposed formulation relies on the discrete extension operator proposed in the aggregated finite element method. This formulation is robust with respect to the location of the boundary/interface within the cell. One can prove enhanced stability results, not only on the physical domain, but on the whole active mesh. However, the stability constants grow exponentially with the polynomial order being used, since the underlying extension operators are defined via extrapolation. To address this issue, we introduce a new variant of aggregated finite elements, in which the extension in the physical domain is an interpolation for polynomials of order higher than two. As a result, the stability constants only grow at a polynomial rate with the order of approximation. We demonstrate that this approach enables robust high-order approximations with the aggregated finite element method. The proposed method is consistent, optimally convergent, and with a condition number that scales optimally for high order approximation., This research was partially funded by the Australian Government through the Australian Research Council (project number DP210103092), the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme and the project RTI2018-096898-B-I00 from the “FEDER/Ministerio de Ciencia e Innovación (MCIN) – Agencia Estatal de Investigación (AEI)”. F. Verdugo acknowledges support from the “Severo Ochoa Program for Centers of Excellence in R&D (2019-2023)” under the grant CEX2018-000797-S funded by MCIN/AEI/10.13039/501100011033. This work was also supported by computational resources provided by the Australian Government through NCI under the National Computational Merit Allocation Scheme., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D1.2 First release of the softwares

  • Tosi, Riccardo|||0000-0002-0133-8367
  • Amela Milian, Ramon
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Roig Pina, Carlos Alejandro
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Rossi, Riccardo|||0000-0003-0528-7074
This deliverable presents the software release of the Kratos Multiphysics software [3], ”a framework for building parallel, multi-disciplinary simulation software, aiming at modularity, extensibility, and high performance. Kratos is written in C++, and counts with an extensive Python interface”. In this deliverable we focus on the development of Uncertainty Quantification inside Kratos. This takes place in the MultilevelMonteCarloApplication, a recent development inside the software that allows to deal with uncertainty quantification.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Mainstream vs. emerging HPC: metrics, trade-offs and lessons learned

  • Radulović, Milan
  • Asifuzzaman, Kazi
  • Živanovič, Darko
  • Rajovic, Nikola
  • Colin de Verdiére, Guillaume
  • Pleiter, Dirk
  • Marazakis, Manolis
  • Kallimanis, Nikolaos
  • Carpenter, Paul Matthew
  • Radojković, Petar
  • Ayguadé Parra, Eduard|||0000-0002-5146-103X
©2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Various servers with different characteristics and architectures are hitting the market, and their evaluation and comparison in terms of HPC features is complex and multidimensional. In this paper, we share our experience of evaluating a diverse set of HPC systems, consisting of three mainstream and five emerging architectures. We evaluate the performance and power efficiency using prominent HPC benchmarks, High-Performance Linpack (HPL) and High Performance Conjugate Gradients (HPCG), and expand our analysis using publicly available specialized kernel benchmarks, targeting specific system components. In addition to a large body of quantitative results, we emphasize six usually overlooked aspects of the HPC platforms evaluation, and share our conclusions and lessons learned. Overall, we believe that this paper will improve the evaluation and comparison of HPC platforms, making a first step towards a more reliable and uniform methodology., This work was supported by the Spanish Ministry of Science and Technology (project TIN2015-65316-P), Generalitat de Catalunya (contracts 2014-SGR-1051 and 2014-SGR-1272), Severo Ochoa Programme (SEV-2015-0493) of the Spanish Government; and the European Union’s Horizon 2020 research and innovation programme under ExaNoDe project (grant agreement No 671578)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

On the use of ensemble averaging techniques to accelerate the Uncertainty Quantification of CFD predictions in wind engineering

  • Tosi, Riccardo|||0000-0002-0133-8367
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Pons Prats, Jordi|||0000-0002-4930-9135
  • Principe, Ricardo Javier|||0000-0002-1478-2651
  • Rossi, Riccardo|||0000-0003-0528-7074
In this work we focus on reducing the wall clock time required to compute statistical estimators of highly chaotic incompressible flows on high performance computing systems. Our approach consists of replacing a single long-term simulation by an ensemble of multiple independent realizations, which are run in parallel. A failure probability convergence criteria must be satisfied by the statistical estimator of interest to assess convergence. The error analysis leads to the identification of two error contributions: the initialization bias and the statistical error. We propose an approach to systematically detect the burn-in time needed in order to minimize the initialization bias, as well as techniques to choose the effective time needed to keep the statistical error under control. This is accompanied by strategies to reduce simulation cost. The proposed method is assessed in application to the prediction of the drag force over high rise buildings and specifically in application to the CAARC building, a relevant benchmark for the wind engineering community., The authors thank Prof. Barbara Wohlmuth and Dr. Brendan Keith for their valuable discussions and contributions to the subject. This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 800898 and from project RTI2018-096898-B-I00 from the FEDER/Ministerio de Ciencia e Innovación - Agencia Estatal de Investigación. The authors also acknowledge the Severo Ochoa Centre of Excellence (2019–2023), which financially supported this work under the grant CEX2018-000797-S funded by MCIN/AEI/10.13039/501100011033. The authors thankfully acknowledge the computer resources at MareNostrum and the technical support provided by Barcelona Supercomputing Center (IM-2020-2-0030). This work was supported by the Ministry of Education, Youth and Sports of the Czech Republic through the e-INFRA CZ (ID:90140). Dr. Jordi Pons-Prats acknowledges the support of the Serra Hunter programme by the Catalan Government., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Geometrical discretisations for unfitted finite elements on explicit boundary representations

  • Badia, Santiago|||0000-0003-2391-4086
  • Martorell Pol, Pere Antoni
  • Verdugo Rojano, Francesc|||0000-0003-3667-443X
Unfitted (also known as embedded or immersed) finite element approximations of partial differential equations are very attractive because they have much lower geometrical requirements than standard body-fitted formulations. These schemes do not require body-fitted unstructured mesh generation. In turn, the numerical integration becomes more involved, because one has to compute integrals on portions of cells (only the interior part). In practice, these methods are restricted to level-set (implicit) geometrical representations, which drastically limit their application. Complex geometries in industrial and scientific problems are usually determined by (explicit) boundary representations. In this work, we propose an automatic computational framework for the discretisation of partial differential equations on domains defined by oriented boundary meshes. The geometrical kernel that connects functional and geometry representations generates a two-level integration mesh and a refinement of the boundary mesh that enables the straightforward numerical integration of all the terms in unfitted finite elements. The proposed framework has been applied with success on all analysis-suitable oriented boundary meshes (almost 5,000) in the Thingi10K database and combined with an unfitted finite element formulation to discretise partial differential equations on the corresponding domains., This research was partially funded by the Australian Government through the Australian Research Council (project number DP210103092), the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme and the project RTI2018- 096898-B-I00 from the “FEDER/Ministerio de Ciencia e Innovación – Agencia Estatal de Investigación”. F. Verdugo acknowledges support from the Spanish Ministry of Economy and Competitiveness through the “Severo Ochoa Programme for Centers of Excellence in R&D (CEX2018-000797-S)". P.A. Martorell aknowledges the support recieved from Universitat Politècnica de Catalunya and Santander Bank through an FPI fellowship (FPI-UPC 2019). This work was also supported by computational resources provided by the Australian Government through NCI under the National Computational Merit Allocation Scheme., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D1.3 First public release of the solver

  • Ayoul-Guilmard, Quentin
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Ejarque, Jorge|||0000-0003-4725-5097
  • Ganesh, Sundar
  • Nobile, Fabio
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Soriano Ortiz, Cecilia|||0000-0002-2445-5398
  • Roig Pina, Carlos Alejandro
  • Rossi, Riccardo|||0000-0003-0528-7074
  • Tosi, Riccardo|||0000-0002-0133-8367
This deliverable presents the software release of Kratos Multiphysics, together with the XMC library, Hyperloom and PyCOMPSs API definition [8]. This report is meant to serve as a supplement to the public release of the software. Kratos is “a framework for building parallel, multi-disciplinary simulation software, aiming at modularity, extensibility, and high performance. Kratos is written in C++, and counts with an extensive Python interface”. XMC is a python library for hierarchical Monte Carlo algorithms. Hyperloom and PyCOMPSs are environments for enabling parallel and distributed computation.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

The aggregated unfitted finite element method on parallel tree-based adaptive meshes

  • Badia, Santiago|||0000-0003-2391-4086
  • Martín, Alberto F.
  • Miranda Neiva, Eric|||0000-0002-1220-9624
  • Verdugo Rojano, Francesc|||0000-0003-3667-443X
In this work, we present an adaptive unfitted finite element scheme that combines the aggregated finite element method with parallel adaptive mesh refinement. We introduce a novel scalable distributed-memory implementation of the resulting scheme on locally adapted Cartesian forest-of-trees meshes. We propose a two-step algorithm to construct the finite element space at hand by means of a discrete extension operator that carefully mixes aggregation constraints of problematic degrees of freedom, which get rid of the small cut cell problem, and standard hanging degree of freedom constraints, which ensure trace continuity on nonconforming meshes. Following this approach, we derive a finite element space that can be expressed as the original one plus well-defined linear constraints. Moreover, it requires minimum parallelization effort, using standard functionality available in existing large-scale finite element codes. Numerical experiments demonstrate its optimal mesh adaptation capability, robustness to cut location, and parallel efficiency, on classical Poisson hp-adaptivity benchmarks. Our work opens the path to functional and geometrical error-driven dynamic mesh adaptation with the aggregated finite element method in large-scale realistic scenarios. Likewise, it can offer guidance for bridging other scalable unfitted methods and parallel adaptive mesh refinement., This work was supported by the European Commission under the FET-HPC ExaQUte project (grant 800898) within the Horizon 2020 Framework Programme and the project RTI2018- 096898-B-I00, by the Barcelona Supercomputing Center (RES-ActivityID: FI-2019-1-0007, IM-2019- 2-0007, IM-2019-3-0008), and by the Australian Government. The work of the third author was supported by the Catalan Government through an FI fellowship (2019 FI-B2-00090, 2018 FI-B1- 00095, 2017 FI-B-00219). The work of the fourth author was supported by the Spanish Ministry of Economy and Competitiveness through the “Severo Ochoa Programme for Centers of Excellence in R&D (CEX2018-000797-S)” and Secretaria d’Universitats i Recerca of the Catalan Government in the framework of the Beatriu Pinós Program (grant 2016 BP 00145)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Linking ghost penalty and aggregated unfitted methods

  • Badia, Santiago|||0000-0003-2391-4086
  • Miranda Neiva, Eric|||0000-0002-1220-9624
  • Verdugo Rojano, Francesc|||0000-0003-3667-443X
In this work, we analyse the links between ghost penalty stabilisation and aggregation-based discrete extension operators for the numerical approximation of elliptic partial differential equations on unfitted meshes. We explore the behaviour of ghost penalty methods in the limit as the penalty parameter goes to infinity, which returns a strong version of these methods. We observe that these methods suffer locking in that limit. On the contrary, aggregated finite element spaces are locking-free because they can be expressed as an extension operator from well-posed to ill-posed degrees of freedom. Next, we propose novel ghost penalty methods that penalise the distance between the solution and its aggregation-based discrete extension. These methods are locking-free and converge to aggregated finite element methods in the infinite penalty parameter limit. We include an exhaustive set of numerical experiments in which we compare weak (ghost penalty) and strong (aggregated finite elements) schemes in terms of error quantities, condition numbers and sensitivity with respect to penalty coefficients on different geometries, intersection locations and mesh topologies., This research was partially funded by the Australian Government through the Australian Research Council (project number DP210103092), the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme and the projects RTI2018-096898-B-I00 and ERC2018-092843 from the “FEDER/Ministerio de Ciencia e Innovación – Agencia Estatal de Investigación”. F. Verdugo acknowledges support from the Spanish Ministry of Economy and Competitiveness through the “Severo Ochoa Programme for Centers of Excellence in R&D (CEX2018-000797-S)”. F. Verdugo acknowledges support from the Secretaria d’Universitats i Recerca of the Catalan Government, Spain in the framework of the Beatriu Pinós Program (Grant Id.: 2016 BP 00145). This work was also supported by computational resources provided by the Australian Government through NCI under the National Computational Merit Allocation Scheme., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D6.4 Report on stochastic optimisation for unsteady problems

  • Ayoul-Guilmard, Quentin
  • Nobile, Fabio
  • Ganesh, Sundar
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Kodakkal, Anoop
  • Soriano Ortiz, Cecilia|||0000-0002-2445-5398
  • Rossi, Riccardo|||0000-0003-0528-7074
This report brings together methodological research on stochastic optimisation and work on benchmark and target applications of the ExaQute project, with a focus on unsteady problems. A practical, general method for the optimisation of the conditional value at risk is proposed. Three different optimisation problems are described: an oscillator problem selected as a suitable trial and illustration case; the shape optimisation of an airfoil, chosen as a benchmark application in the project; the shape optimisation of a tall building, which is the challenging target application set for ExaQUte. For each problem, the current developments and results are presented, the application of the proposed method is discussed, and the work to be done until the end of the project is laid out.
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D5.3 Report on theoretical work to allow the use of MLMC with adaptive mesh refinement

  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Tosi, Riccardo|||0000-0002-0133-8367
  • Nobile, Fabio
  • Rossi, Riccardo|||0000-0003-0528-7074
This documents describes several studies undertaken to assess the applicability of MultiLevel Monte Carlo (MLMC) methods to problems of interest; namely in turbulent fluid flow over civil engineering structures. Several numerical experiments are presented wherein the convergence of quantities of interest with mesh parameters are studied at different Reynolds’ numbers and geometries. It was found that MLMC methods could be used successfully for low Reynolds’ number flows when combined with appropriate Adaptive Mesh Refinement (AMR) strategies. However, the hypotheses for optimal MLMC performance were found to not be satisfied at higher turbulent Reynolds’ numbers despite the use of AMR strategies. Recommendations are made for future research directions based on these studies. A tentative outline for an MLMC algorithm with adapted meshes is made, as well as recommendations for alternatives to MLMC methods for cases where the underlying assumptions for optimal MLMC performance are not satisfied.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A parallel dynamic asynchronous framework for uncertainty quantification by hierarchical Monte Carlo algorithms

  • Tosi, Riccardo|||0000-0002-0133-8367
  • Amela Milian, Ramon
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Rossi, Riccardo|||0000-0003-0528-7074
The necessity of dealing with uncertainties is growing in many different fields of science and engineering. Due to the constant development of computational capabilities, current solvers must satisfy both statistical accuracy and computational efficiency. The aim of this work is to introduce an asynchronous framework for Monte Carlo and Multilevel Monte Carlo methods to achieve such a result. The proposed approach presents the same reliability of state of the art techniques, and aims at improving the computational efficiency by adding a new level of parallelism with respect to existing algorithms: between batches, where each batch owns its hierarchy and is independent from the others. Two different numerical problems are considered and solved in a supercomputer to show the behavior of the proposed approach., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 800898. This work has been supported by the Spanish Government (contracts SEV2015- 0493 and TIN2015-65316-P), by the Generalitat de Catalunya (contract 2014-SGR-1051). The authors thankfully acknowledge the computer resources at MareNostrum and the technical support provided by Barcelona Supercomputing Center (IM-2020-1-0016)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Subdomain deflation combined with local AMG: a case study using AMGCL library

  • Demidov, D.
  • Rossi, Riccardo|||0000-0003-0528-7074
The final publication is available at Springer via http://dx.doi.org/10.1134/S1995080220040071, The paper proposes a combination of the subdomain deflation method and local algebraic multigrid as a scalable distributed memory preconditioner that is able to solve large linear systems of equations. The implementation of the algorithm is made available for the community as part of an open source AMGCL library. The solution targets both homogeneous (CPU-only) and heterogeneous (CPU/GPU) systems, employing hybrid MPI/OpenMP approach in the former and a combination of MPI, OpenMP, and CUDA in the latter cases. The use of OpenMP minimizes the number of MPI processes, thus reducing the communication overhead of the deflation method and improving both weak and strong scalability of the preconditioner. The examples of scalar (single degree of freedom per grid node), Poisson-like, systems as well as non-scalar problems, stemming out of the discretization of the Navier-Stokes equations, are considered in order to estimate performance of the implemented algorithm. A comparison with a traditional global AMG preconditioner based on a well-established Trilinos ML package is provided., Contribution of Dr. Demidov was funded by the state assignment to the Joint Supercomputer Center of theRussian Academy of Sciences for Scientific Research and Russian Foundation for Basic Research, grant no. 18-07-00964. Dr. Rossi acknowledges the financial support to CIMNE via the CERCA Programme/Generalitat de Catalunya and the support of the ExaQUte FetHPC, project GA 800898. The authors thankfully acknowledge the support of the PRACE program (project 2010PA4058), in providing access to the MareNostrum 4 and PizDaint clusters. Without such resources the testing would not have been possible. The help of Prof. Labarta of the POP Center of Excellence in improving the NUMA scalability of the solver is also gratefully acknowledged., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A discontinuous Nitsche-based finite element formulation for the imposition of the Navier-slip condition over embedded volumeless geometries

  • Zorrilla Martínez, Rubén|||0000-0001-8270-7170
  • Larese De Tetto, Antonia|||0000-0002-7284-3926
  • Rossi, Riccardo|||0000-0003-0528-7074
This is the peer reviewed version of the following article: [Zorrilla, R, Larese de Tetto, A, Rossi, R. A discontinuous Nitsche-based finite element formulation for the imposition of the Navier-slip condition over embedded volumeless geometries. Int J Numer Meth Fluids. 2021; 93: 2968– 3003. https://doi.org/10.1002/fld.5018], which has been published in final form at https://doi.org/10.1002/fld.5018. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving, This work describes a novel formulation for the simulation of incompressible Navier–Stokes problems involving nonconforming discretizations of membrane-like bodies. The new proposal relies on the use of a modified finite element space within the elements intersected by the embedded geometry, which is represented by a discontinuous (or element-by-element) level set function. This is combined with a Nitsche-based imposition of the general Navier-slip boundary condition, to be intended as a wall law model. Thanks to the use of an alternative finite element space, the formulation is capable of reproducing exactly discontinuities across the embedded interface, while preserving the structure of the graph of the discrete matrix. The performance, accuracy and convergence of the new proposal is compared with analytical solutions as well as with a body fitted reference technique. Moreover, the proposal is tested against another similar embedded approach. Finally, a realistic application showcasing the possibilities of the method is also presented., European Commission, H2020-FETHPC-2016-2017-800898; International Graduate School of Science and Engineering (IGSSE)), ATMOPACE; Istituto Nazionale di Alta Matematica “Francesco Severi”, Ministero dell'Università e della Ricerca, Programma per Giovani Ricercatori “Rita Levi Mon; Secretaría de Estado de Investigación, Desarrollo e Innovación, CEX2018-000797-S, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Computational modeling of the fluid flow in type B aortic dissection using a modified finite element embedded formulation

  • Zorrilla Martínez, Rubén|||0000-0001-8270-7170
  • Soudah Prieto, Eduardo|||0000-0002-2301-4718
  • Rossi, Riccardo|||0000-0003-0528-7074
The final publication is available at Springer via http://dx.doi.org/10.1007/s10237-020-01291-x, This work explores the use of an embedded computational fluid dynamics method to study the type B aortic dissection. The use of the proposed technique makes it possible to easily test different intimal flap configurations without any need of remeshing. To validate the presented methodology, we take as reference test case an in vitro experiment present in the literature. This experiment, which considers several intimal flap tear configurations (number, size and location), mimics the blood flow in a real type B aortic dissection. We prove the correctness and suitability of the presented approach by comparing the pressure values and waveform. The obtained results exhibit a remarkable similarity with the experimental reference data. Complementary, we present a feasible surgical application of the presented computer method. The aim is to help the clinicians in the decision making before the type B aortic dissection surgical fenestration. The capabilities of the proposed technique are exploited to efficiently create artificial reentry tear configurations. We highlight that only the radius and center of the reentry tear need to be specified by the clinicians, without any need to modify neither the model geometry nor the mesh. The obtained computational surgical fenestration results are in line with the medical observations in similar clinical studies., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A stabilised displacement–volumetric strain formulation for nearly incompressible and anisotropic materials

  • Rossi, Riccardo|||0000-0003-0528-7074
  • Zorrilla Martínez, Rubén|||0000-0001-8270-7170
  • Codina, Ramon|||0000-0002-7412-778X
The simulation of structural problems involving the deformations of volumetric bodies is of paramount importance in many areas of engineering. Although the use of tetrahedral elements is extremely appealing, tetrahedral discretisations are generally known as very stiff and are hence often avoided in typical simulation workflows. The development of mixed displacement–pressure approaches has allowed to effectively overcome this problem leading to a class of locking-free elements which can effectively compete with hexahedral discretisations while retaining obvious advantages in the mesh generation step. Despite such advantages the adoption of the technology within commercial codes is not yet pervasive. This can be attributed to two different reasons: the difficulty in making use of standard constitutive libraries and the implied continuity of the pressure, which makes the application of the method questionable in the context of multi-material problems. Current paper proposes the adoption of the volumetric strain instead of the pressure as a nodal value. Such choice leads to the definition of a modified strain making the use of standard strain-driven constitutive laws straightforward. At the same time, the continuity of the volumetric strain across multimaterial interfaces can be understood as a sort of kinematic constraint (stresses can still remain discontinuous across material interfaces). The new element also opens the door to the use of anisotropic constitutive laws, which are typically problematic in the context of mixed elements., This research has been partly supported by the European Commission (EC) through the project ExaQUte (H2020-FETHPC-2016-2017-800898). The authors also acknowledge financial support from the Spanish Ministry of Economy and Competitiveness, through the “Severo Ochoa Programme for Centres of Excellence in R& D” (CEX2018-000797-S). R. Codina acknowledges the support received from the ICREA Acadèmia Research Program, from the Catalan Government ., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Estudio, informe, memoria (Report)

ExaQUte: D1.4 Final public release of the solver

  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Nobile, Fabio
  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Ejarque, Jorge|||0000-0003-4725-5097
  • Cirrottola, Luca
  • Froehly, Algiane
  • Keith, Brendan
  • Kodakkal, Anoop
  • Núñez Corbacho, Marc|||0000-0002-4149-6829
  • Roig Pina, Carlos Alejandro
  • Rossi, Riccardo|||0000-0003-0528-7074
  • Tosi, Riccardo|||0000-0002-0133-8367
  • Soriano Ortiz, Cecilia|||0000-0002-2445-5398
This deliverable presents the final software release of Kratos Multiphysics, together with the XMC library, Hyperloom and PyCOMPSs API definitions [13]. This release also contains the latest developements on MPI parallel remeshing in ParMmg. This report is meant to serve as a supplement to the public release of the software. Kratos is “a framework for building parallel, multi-disciplinary simulation software, aiming at modularity, extensibility, and high performance. Kratos is written in C++, and counts with an extensive Python interface”. XMC is “a Python library for parallel, adaptive, hierarchical Monte Carlo algorithms, aiming at reliability, modularity, extensibility and high performance“. Hyperloom and PyCOMPSs are environments for enabling parallel and distributed computation. ParMmg is an open source software which offers the parallel mesh adaptation of three dimensional volume meshes.
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

A modified Finite Element formulation for the imposition of the slip boundary condition over embedded volumeless geometries

  • Zorrilla Martínez, Rubén|||0000-0001-8270-7170
  • Larese De Tetto, Antonia|||0000-0002-7284-3926
  • Rossi, Riccardo|||0000-0003-0528-7074
This work describes a novel formulation for the simulation of Navier–Stokes problems including embedded objects. The new proposal is based on the use of a modified finite element space, which replaces the standard one within the elements intersected by the immersed geometry. The modified space is able to exactly reproduce the jumps happening at the embedded boundary while preserving the conformity across the faces intersected by the embedded object. The paper focuses particularly on the imposition of a slip boundary condition on the surface of the embedded geometry, proposing a new technique for the application of such constraint. The new proposal is carefully benchmarked using the results of a body fitted technique and of an alternative embedded approach. Potential applications of interest are also presented., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

PyCOMPSs as an instrument for translational computer science

  • Badia Sala, Rosa Maria|||0000-0003-2941-5499
  • Conejero Bañón, Francisco Javier
  • Ejarque Artigas, Jorge
  • Lezzi, Daniele|||0000-0001-5081-7244
  • Lordan Gomis, Francesc|||0000-0002-9845-8890
With the advent of distributed computing, the need for frameworks that facilitate its programming and management has also appeared. These tools have typically been used to support the research on application areas that require them. This poses good initial conditions for translational computer science (TCS), although this does not always occur. This article describes our experience with the PyCOMPSs project, a programming model for distributed computing. While it is a research instrument for our team, it has also been applied in multiple real use cases under the umbrella of European Funded projects, or as part of internal projects between various departments at the Barcelona Supercomputing Center. This article illustrates how the authors have engaged in TCS as an underlying research methodology, collecting experiences from three European projects., This work was supported in part by Spanish Government under Contract TIN2015-65316-P, in part by the Generalitat de Catalunya under Contract 2014-SGR-1051, and in part by the European Commission’s Horizon 2020 Framework program through BioExcel Center of Excellence under Contract 823830 and Contract 675728, in part by the ExaQUte Project under Contract 800898, in part by the European High-Performance Computing Joint Undertaking (JU) under Grant 955558, in part by the MCIN/AEI/10.13039/501100011033, and in part by the European Union NextGenerationEU/PRTR., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Solution of Navier–Stokes equations on a fixed mesh using conforming enrichment of velocity and pressure

  • Tanyildiz, Deniz Cagri
  • Martí, Julio Marcelo|||0000-0002-6971-1797
  • Rossi, Riccardo|||0000-0003-0528-7074
The final publication is available at Springer via http://dx.doi.org/10.1007/s40571-019-00285-6, Simulation of fluid flows of multi-materials is an intriguing topic in computational mechanics. Capturing the physics of the interface between different materials poses a challenge because of the discontinuities that may occur on the interface. Several methods have been proposed in the literature to deal with this issue. In this paper, a technique based on Nitsche’s method has been employed on a fixed mesh combined with the PFEM-2 strategy for the solution of Navier–Stokes equations on multi-fluid flows. The novelty of this technique is its capability of capturing the strong and weak discontinuities and its compatibility for the application of various types of boundary conditions on the interface., The research that has been presented in this publication and the results obtained have been conducted and achieved with the support of the Ministerio de Economía y Competitividad (MINECO) from Spain and its funding program Ayudas para Contratos Predoctorales para la Formación de Doctores (ref. BES-2014-070613). Author Deniz C. Tanyildiz would like to express special thanks to the project: PARFLOW (ref. BIA2013-49007-C2-1-R). Dr. Riccardo Rossi would like to express special thanks to the project: EXAQUTE (ref. 800898). Moreover, the authors would like to express their gratitude to Dr. Joan Baiges from Polytechnical University of Catalonia, for his substantial help on Nitsche’s method., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A robust and scalable unfitted adaptive finite element framework for nonlinear solid mechanics

  • Badia, Santiago
  • Caicedo Silva, Manuel Alejandro
  • Martín, Alberto F.
  • Principe, Ricardo Javier
In this work, we bridge standard Adaptive Mesh Refinement and coarsening (AMR) on scalable octree background meshes and robust unfitted Finite Element (FE) formulations for the automatic and efficient solution of large-scale nonlinear solid mechanics problems posed on complex geometries, as an alternative to standard body-fitted formulations, unstructured mesh generation and graph partitioning strategies. We pay special attention to those aspects requiring a specialized treatment in the extension of the unfitted -adaptive Aggregated Finite Element Method (-AgFEM) on parallel tree-based adaptive meshes, recently developed for linear scalar elliptic problems, to handle nonlinear problems in solid mechanics. In order to accurately and efficiently capture localized phenomena that frequently occur in nonlinear solid mechanics problems, we perform pseudo time-stepping in combination with -adaptive dynamic mesh refinement and re-balancing driven by a-posteriori error estimators. The method is implemented considering both irreducible and mixed (u/p) formulations and thus it is able to robustly face problems involving incompressible materials. In the numerical experiments, both formulations are used to model the inelastic behavior of a wide range of compressible and incompressible materials. First, a selected set of benchmarks is reproduced as a verification step. Second, a set of experiments is presented with problems involving complex geometries. Among them, we model a cantilever beam problem with spherical hollows distributed in a simple cubic (SC) array. This test involves a discrete domain with up to 11.7M Degrees Of Freedom (DOFs) solved in less than two hours on 3072 cores of a parallel supercomputer., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D5.4 Report on MLMC for time dependent problems

  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Núñez Corbacho, Marc
  • Tosi, Riccardo
  • Nobile, Fabio
  • Rossi, Riccardo
In this report, we study the use of Multi-Level Monte Carlo (MLMC) methods for time dependent problems. It was found that the usability of MLMC methods depends strongly on whether or not the underlying time dependent problem is chaotic in nature. Numerical experiments are conducted on both simple problems, as well as fluid flow problems of practical interest to the ExaQUte project, to demonstrate this. For the non-chaotic cases, the hypotheses that enable the use of MLMC methods were found to be satisfied. For the chaotic cases, especially the case of high Reynolds’ number fluid flow, the hypotheses were not satisfied. However, it was found that correlations between the different levels were high enough to merit the use of multi-fidelity or control-variate approaches. It was also noted that MLMC methods could work for chaotic problems if the time window of analysis were chosen to be small enough. Future studies are proposed to examine this possibility., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

PyCOMPSs as an instrument for translational computer science

  • Badia Sala, Rosa Maria
  • Conejero Bañón, Francisco Javier
  • Ejarque Artigas, Jorge
  • Lezzi, Daniele
  • Lordan Gomis, Francesc
With the advent of distributed computing, the need for frameworks that facilitate its programming and management has also appeared. These tools have typically been used to support the research on application areas that require them. This poses good initial conditions for translational computer science (TCS), although this does not always occur. This article describes our experience with the PyCOMPSs project, a programming model for distributed computing. While it is a research instrument for our team, it has also been applied in multiple real use cases under the umbrella of European Funded projects, or as part of internal projects between various departments at the Barcelona Supercomputing Center. This article illustrates how the authors have engaged in TCS as an underlying research methodology, collecting experiences from three European projects., This work was supported in part by Spanish Government under Contract TIN2015-65316-P, in part by the Generalitat de Catalunya under Contract 2014-SGR-1051, and in part by the European Commission’s Horizon 2020 Framework program through BioExcel Center of Excellence under Contract 823830 and Contract 675728, in part by the ExaQUte Project under Contract 800898, in part by the European High-Performance Computing Joint Undertaking (JU) under Grant 955558, in part by the MCIN/AEI/10.13039/501100011033, and in part by the European Union NextGenerationEU/PRTR., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D1.4 Final public release of the solver

  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Nobile, Fabio
  • Badia Sala, Rosa Maria
  • Ejarque, Jorge
  • Cirrottola, Luca
  • Froehly, Algiane
  • Keith, Brendan
  • Kodakkal, Anoop
  • Núñez Corbacho, Marc
  • Roig Pina, Carlos Alejandro
  • Rossi, Riccardo
  • Tosi, Riccardo
  • Soriano Ortiz, Cecilia
This deliverable presents the final software release of Kratos Multiphysics, together with the XMC library, Hyperloom and PyCOMPSs API definitions [13]. This release also contains the latest developements on MPI parallel remeshing in ParMmg. This report is meant to serve as a supplement to the public release of the software. Kratos is “a framework for building parallel, multi-disciplinary simulation software, aiming at modularity, extensibility, and high performance. Kratos is written in C++, and counts with an extensive Python interface”. XMC is “a Python library for parallel, adaptive, hierarchical Monte Carlo algorithms, aiming at reliability, modularity, extensibility and high performance“. Hyperloom and PyCOMPSs are environments for enabling parallel and distributed computation. ParMmg is an open source software which offers the parallel mesh adaptation of three dimensional volume meshes., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D5.2 Release of ExaQUte MLMC Python engine

  • Amela Milian, Ramon
  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Tosi, Riccardo
  • Badia Sala, Rosa Maria
  • Nobile, Fabio
  • Rossi, Riccardo
In this deliverable, the ExaQUte xmc library is introduced. This report is meant to serve as a supplement to the publicly release of the library. In the following sections, the ExaQUte xmc library is described along with its current and future capabilities. The structure of the library, along with its dynamic import mechanism, are described using samples of code. The algorithms behind the example files supplied with the public release are explained in detail as well., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D1.3 First public release of the solver

  • Ayoul-Guilmard, Quentin
  • Badia Sala, Rosa Maria
  • Ejarque, Jorge
  • Ganesh, Sundar
  • Nobile, Fabio
  • Núñez Corbacho, Marc
  • Soriano Ortiz, Cecilia
  • Roig Pina, Carlos Alejandro
  • Rossi, Riccardo
  • Tosi, Riccardo
This deliverable presents the software release of Kratos Multiphysics, together with the XMC library, Hyperloom and PyCOMPSs API definition [8]. This report is meant to serve as a supplement to the public release of the software. Kratos is “a framework for building parallel, multi-disciplinary simulation software, aiming at modularity, extensibility, and high performance. Kratos is written in C++, and counts with an extensive Python interface”. XMC is a python library for hierarchical Monte Carlo algorithms. Hyperloom and PyCOMPSs are environments for enabling parallel and distributed computation., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A discontinuous Nitsche-based finite element formulation for the imposition of the Navier-slip condition over embedded volumeless geometries

  • Zorrilla Martínez, Rubén
  • Larese De Tetto, Antonia
  • Rossi, Riccardo
This is the peer reviewed version of the following article: [Zorrilla, R, Larese de Tetto, A, Rossi, R. A discontinuous Nitsche-based finite element formulation for the imposition of the Navier-slip condition over embedded volumeless geometries. Int J Numer Meth Fluids. 2021; 93: 2968– 3003. https://doi.org/10.1002/fld.5018], which has been published in final form at https://doi.org/10.1002/fld.5018. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving, This work describes a novel formulation for the simulation of incompressible Navier–Stokes problems involving nonconforming discretizations of membrane-like bodies. The new proposal relies on the use of a modified finite element space within the elements intersected by the embedded geometry, which is represented by a discontinuous (or element-by-element) level set function. This is combined with a Nitsche-based imposition of the general Navier-slip boundary condition, to be intended as a wall law model. Thanks to the use of an alternative finite element space, the formulation is capable of reproducing exactly discontinuities across the embedded interface, while preserving the structure of the graph of the discrete matrix. The performance, accuracy and convergence of the new proposal is compared with analytical solutions as well as with a body fitted reference technique. Moreover, the proposal is tested against another similar embedded approach. Finally, a realistic application showcasing the possibilities of the method is also presented., European Commission, H2020-FETHPC-2016-2017-800898; International Graduate School of Science and Engineering (IGSSE)), ATMOPACE; Istituto Nazionale di Alta Matematica “Francesco Severi”, Ministero dell'Università e della Ricerca, Programma per Giovani Ricercatori “Rita Levi Mon; Secretaría de Estado de Investigación, Desarrollo e Innovación, CEX2018-000797-S, Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Geometrical discretisations for unfitted finite elements on explicit boundary representations

  • Badia, Santiago
  • Martorell Pol, Pere Antoni
  • Verdugo Rojano, Francesc
Unfitted (also known as embedded or immersed) finite element approximations of partial differential equations are very attractive because they have much lower geometrical requirements than standard body-fitted formulations. These schemes do not require body-fitted unstructured mesh generation. In turn, the numerical integration becomes more involved, because one has to compute integrals on portions of cells (only the interior part). In practice, these methods are restricted to level-set (implicit) geometrical representations, which drastically limit their application. Complex geometries in industrial and scientific problems are usually determined by (explicit) boundary representations. In this work, we propose an automatic computational framework for the discretisation of partial differential equations on domains defined by oriented boundary meshes. The geometrical kernel that connects functional and geometry representations generates a two-level integration mesh and a refinement of the boundary mesh that enables the straightforward numerical integration of all the terms in unfitted finite elements. The proposed framework has been applied with success on all analysis-suitable oriented boundary meshes (almost 5,000) in the Thingi10K database and combined with an unfitted finite element formulation to discretise partial differential equations on the corresponding domains., This research was partially funded by the Australian Government through the Australian Research Council (project number DP210103092), the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme and the project RTI2018- 096898-B-I00 from the “FEDER/Ministerio de Ciencia e Innovación – Agencia Estatal de Investigación”. F. Verdugo acknowledges support from the Spanish Ministry of Economy and Competitiveness through the “Severo Ochoa Programme for Centers of Excellence in R&D (CEX2018-000797-S)". P.A. Martorell aknowledges the support recieved from Universitat Politècnica de Catalunya and Santander Bank through an FPI fellowship (FPI-UPC 2019). This work was also supported by computational resources provided by the Australian Government through NCI under the National Computational Merit Allocation Scheme., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A modified Finite Element formulation for the imposition of the slip boundary condition over embedded volumeless geometries

  • Zorrilla Martínez, Rubén
  • Larese De Tetto, Antonia
  • Rossi, Riccardo
This work describes a novel formulation for the simulation of Navier–Stokes problems including embedded objects. The new proposal is based on the use of a modified finite element space, which replaces the standard one within the elements intersected by the immersed geometry. The modified space is able to exactly reproduce the jumps happening at the embedded boundary while preserving the conformity across the faces intersected by the embedded object. The paper focuses particularly on the imposition of a slip boundary condition on the surface of the embedded geometry, proposing a new technique for the application of such constraint. The new proposal is carefully benchmarked using the results of a body fitted technique and of an alternative embedded approach. Potential applications of interest are also presented., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A time averaged steady state method for the Navier-Stokes equations

  • Zhao, Mengjie
  • Zorrilla Martínez, Rubén
  • Rossi, Riccardo
  • Wüchner, Roland
This work derives an incompressible Variational Multiscales time-averaged Navier-Stokes formulation that aims at obtaining accurate steady state solutions. Rather than using the standard time instantaneous velocity and pressure, the new formulation devises a time averaging procedure based on rewriting and solving the Navier-Stokes equations in terms of the newly defined time-averaged velocity and pressure. Hence, the method could be understood as a convenient change of variable so that the problem is rewritten directly in terms of the steady state quantities. The important advantage of such a point of view is that it can in principle be applied to any other formulation. Such time averaging procedure is complemented by two time step modification strategies in order to accelerate the convergence to the steady state. The guidelines of an integrated framework are presented in the paper, starting with the description of the proposed numerical technique applied to general incompressible flows. The explanation is enhanced with a 1D non-linear oscillator example. Several results are presented concerning analytical benchmarks, simulation of flows in laminar, transitional and turbulent regimes with and without an inherently steady solution., This research has been partly supported by the International Graduate School of Science and Engineering (IGSSE) and the European Commission (EC) through the projects ATMOPACE and ExaQUte (H2020FETHPC-2016-2017-800898). Rubén Zorrilla gratefully acknowledges the support of the Spanish Government for his FPU Grant (FPU15/03796)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Computational modeling of the fluid flow in type B aortic dissection using a modified finite element embedded formulation

  • Zorrilla Martínez, Rubén
  • Soudah Prieto, Eduardo
  • Rossi, Riccardo
The final publication is available at Springer via http://dx.doi.org/10.1007/s10237-020-01291-x, This work explores the use of an embedded computational fluid dynamics method to study the type B aortic dissection. The use of the proposed technique makes it possible to easily test different intimal flap configurations without any need of remeshing. To validate the presented methodology, we take as reference test case an in vitro experiment present in the literature. This experiment, which considers several intimal flap tear configurations (number, size and location), mimics the blood flow in a real type B aortic dissection. We prove the correctness and suitability of the presented approach by comparing the pressure values and waveform. The obtained results exhibit a remarkable similarity with the experimental reference data. Complementary, we present a feasible surgical application of the presented computer method. The aim is to help the clinicians in the decision making before the type B aortic dissection surgical fenestration. The capabilities of the proposed technique are exploited to efficiently create artificial reentry tear configurations. We highlight that only the radius and center of the reentry tear need to be specified by the clinicians, without any need to modify neither the model geometry nor the mesh. The obtained computational surgical fenestration results are in line with the medical observations in similar clinical studies., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

On the use of ensemble averaging techniques to accelerate the Uncertainty Quantification of CFD predictions in wind engineering

  • Tosi, Riccardo
  • Núñez Corbacho, Marc
  • Pons Prats, Jordi
  • Principe, Ricardo Javier
  • Rossi, Riccardo
In this work we focus on reducing the wall clock time required to compute statistical estimators of highly chaotic incompressible flows on high performance computing systems. Our approach consists of replacing a single long-term simulation by an ensemble of multiple independent realizations, which are run in parallel. A failure probability convergence criteria must be satisfied by the statistical estimator of interest to assess convergence. The error analysis leads to the identification of two error contributions: the initialization bias and the statistical error. We propose an approach to systematically detect the burn-in time needed in order to minimize the initialization bias, as well as techniques to choose the effective time needed to keep the statistical error under control. This is accompanied by strategies to reduce simulation cost. The proposed method is assessed in application to the prediction of the drag force over high rise buildings and specifically in application to the CAARC building, a relevant benchmark for the wind engineering community., The authors thank Prof. Barbara Wohlmuth and Dr. Brendan Keith for their valuable discussions and contributions to the subject. This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 800898 and from project RTI2018-096898-B-I00 from the FEDER/Ministerio de Ciencia e Innovación - Agencia Estatal de Investigación. The authors also acknowledge the Severo Ochoa Centre of Excellence (2019–2023), which financially supported this work under the grant CEX2018-000797-S funded by MCIN/AEI/10.13039/501100011033. The authors thankfully acknowledge the computer resources at MareNostrum and the technical support provided by Barcelona Supercomputing Center (IM-2020-2-0030). This work was supported by the Ministry of Education, Youth and Sports of the Czech Republic through the e-INFRA CZ (ID:90140). Dr. Jordi Pons-Prats acknowledges the support of the Serra Hunter programme by the Catalan Government., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D6.4 Report on stochastic optimisation for unsteady problems

  • Ayoul-Guilmard, Quentin
  • Nobile, Fabio
  • Ganesh, Sundar
  • Núñez Corbacho, Marc
  • Kodakkal, Anoop
  • Soriano Ortiz, Cecilia
  • Rossi, Riccardo
This report brings together methodological research on stochastic optimisation and work on benchmark and target applications of the ExaQute project, with a focus on unsteady problems. A practical, general method for the optimisation of the conditional value at risk is proposed. Three different optimisation problems are described: an oscillator problem selected as a suitable trial and illustration case; the shape optimisation of an airfoil, chosen as a benchmark application in the project; the shape optimisation of a tall building, which is the challenging target application set for ExaQUte. For each problem, the current developments and results are presented, the application of the proposed method is discussed, and the work to be done until the end of the project is laid out., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Robust and scalable h-adaptive aggregated unfitted finite elements for interface elliptic problems

  • Miranda Neiva, Eric
  • Badia, Santiago
This work introduces a novel, fully robust and highly-scalable, -adaptive aggregated unfitted finite element method for large-scale interface elliptic problems. The new method is based on a recent distributed-memory implementation of the aggregated finite element method atop a highly-scalable Cartesian forest-of-trees mesh engine. It follows the classical approach of weakly coupling nonmatching discretisations at the interface to model internal discontinuities at the interface. We propose a natural extension of a single-domain parallel cell aggregation scheme to problems with a finite number of interfaces; it straightforwardly leads to aggregated finite element spaces that have the structure of a Cartesian product. We demonstrate, through standard numerical analysis and exhaustive numerical experimentation on several complex Poisson and linear elasticity benchmarks, that the new technique enjoys the following properties: well-posedness, robustness with respect to cut location and material contrast, optimal (h-adaptive) approximation properties, high scalability and easy implementation in large-scale finite element codes. As a result, the method offers great potential as a useful finite element solver for large-scale interface problems modelled by partial differential equations., Financial support from the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme is gratefully acknowledged. This work has been partially funded by the projects RTI2018-096898-B-I00 and ERC2018-092843 from the “Ministerio de Ciencia e Innovación” of Spain. E. Neiva gratefully acknowledges the support received from the Catalan Government, Spain through a FI fellowship (2019 FI-B2-00090; 2018 FI-B1-00095; 2017 FI-B-00219). S. Badia gratefully acknowledges the support received from the Catalan Government through the ICREA Acadèmia Research Program, Spain. The authors thankfully acknowledge the computer resources at Marenostrum-IV and the technical support provided by the Barcelona Supercomputing Center (RES-ActivityIDs: IM-2019-3-0008, IM-2020-1-0002). Financial support to CIMNE via the CERCA Programme/Generalitat de Catalunya, Spain is also acknowledged., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D4.2 Profiling report of the partner’s tools, complete with performance suggestions

  • Amela Milian, Ramon
  • Badia Sala, Rosa Maria
  • Böhm, Stanislav
  • Tosi, Riccardo
  • Rossi, Riccardo
This deliverable focuses on the proling activities developed in the project with the partner's applications. To perform this proling activities, a couple of benchmarks were dened in collaboration with WP5. The rst benchmark is an embarrassingly parallel benchmark that performs a read and then multiple writes of the same object, with the objective of stressing the memory and storage systems and evaluate the overhead when these reads and writes are performed in parallel. A second benchmark is dened based on the Continuation Multi Level Monte Carlo (C-MLMC) algorithm. While this algorithm is normally executed using multiple levels, for the proling and performance analysis objectives, the execution of a single level was enough since the forthcoming levels have similar performance characteristics. Additionally, while the simulation tasks can be executed as parallel (multi-threaded tasks), in the benchmark, single threaded tasks were executed to increase the number of simulations to be scheduled and stress the scheduling engines. A set of experiments based on these two benchmarks have been executed in the MareNostrum 4 supercomputer and using PyCOMPSs as underlying programming model and dynamic scheduler of the tasks involved in the executions. While the rst benchmark was executed several times in a single iteration, the second benchmark was executed in an iterative manner, with cycles of 1) Execution and trace generation; 2) Performance analysis; 3) Improvements. This had enabled to perform several improvements in the benchmark and in the scheduler of PyCOMPSs. The initial iterations focused on the C-MLMC structure itself, performing re-factors of the code to remove ne grain and sequential tasks and merging them in larger granularity tasks. The next iterations focused on improving the PyCOMPSs scheduler, removing existent bottlenecks and increasing its performance by making the scheduler a multithreaded engine. While the results can still be improved, we are satised with the results since the granularity of the simulations run in this evaluation step are much ner than the one that will be used for the real scenarios. The deliverable nishes with some recommendations that should be followed along the project in order to obtain good performance in the execution of the project codes., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Mainstream vs. emerging HPC: metrics, trade-offs and lessons learned

  • Radulović, Milan
  • Asifuzzaman, Kazi
  • Živanovič, Darko
  • Rajovic, Nikola
  • Colin de Verdiére, Guillaume
  • Pleiter, Dirk
  • Marazakis, Manolis
  • Kallimanis, Nikolaos
  • Carpenter, Paul Matthew
  • Radojković, Petar
  • Ayguadé Parra, Eduard
©2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., Various servers with different characteristics and architectures are hitting the market, and their evaluation and comparison in terms of HPC features is complex and multidimensional. In this paper, we share our experience of evaluating a diverse set of HPC systems, consisting of three mainstream and five emerging architectures. We evaluate the performance and power efficiency using prominent HPC benchmarks, High-Performance Linpack (HPL) and High Performance Conjugate Gradients (HPCG), and expand our analysis using publicly available specialized kernel benchmarks, targeting specific system components. In addition to a large body of quantitative results, we emphasize six usually overlooked aspects of the HPC platforms evaluation, and share our conclusions and lessons learned. Overall, we believe that this paper will improve the evaluation and comparison of HPC platforms, making a first step towards a more reliable and uniform methodology., This work was supported by the Spanish Ministry of Science and Technology (project TIN2015-65316-P), Generalitat de Catalunya (contracts 2014-SGR-1051 and 2014-SGR-1272), Severo Ochoa Programme (SEV-2015-0493) of the Spanish Government; and the European Union’s Horizon 2020 research and innovation programme under ExaNoDe project (grant agreement No 671578)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D5.3 Report on theoretical work to allow the use of MLMC with adaptive mesh refinement

  • Ayoul-Guilmard, Quentin
  • Ganesh, Sundar
  • Núñez Corbacho, Marc
  • Tosi, Riccardo
  • Nobile, Fabio
  • Rossi, Riccardo
This documents describes several studies undertaken to assess the applicability of MultiLevel Monte Carlo (MLMC) methods to problems of interest; namely in turbulent fluid flow over civil engineering structures. Several numerical experiments are presented wherein the convergence of quantities of interest with mesh parameters are studied at different Reynolds’ numbers and geometries. It was found that MLMC methods could be used successfully for low Reynolds’ number flows when combined with appropriate Adaptive Mesh Refinement (AMR) strategies. However, the hypotheses for optimal MLMC performance were found to not be satisfied at higher turbulent Reynolds’ numbers despite the use of AMR strategies. Recommendations are made for future research directions based on these studies. A tentative outline for an MLMC algorithm with adapted meshes is made, as well as recommendations for alternatives to MLMC methods for cases where the underlying assumptions for optimal MLMC performance are not satisfied., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Performance meets programmabilty: Enabling native Python MPI tasks in PyCOMPSs

  • Elshazly, Hatem Mohamed Abdelfattah Eid
  • Lordan Gomis, Francesc
  • Ejarque Artigas, Jorge
  • Badia Sala, Rosa Maria
©2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works., The increasing complexity of modern and future computing systems makes it challenging to develop applications that aim for maximum performance. Hybrid parallel programming models offer new ways to exploit the capabilities of the underlying infrastructure. However, the performance gain is sometimes accompanied by increased programming complexity. We introduce an extension to PyCOMPSs, a high-level task-based parallel programming model for Python applications, to support tasks that use MPI natively as part of the task model. Without compromising application's programmability, using Native MPI tasks in PyCOMPSs offers up to 3x improvement in total performance for compute intensive applications and up to 1.9x improvement in total performance for I/O intensive applications over sequential implementation of the tasks., This work is partially supported by the European Union through the Horizon 2020 research and innovation programme under contracts 721865 (EXPERTISE Project) and 800898 (ExaQUte project), by the Spanish Government (TIN2015- 65316-P) and the Generalitat de Catalunya (contract 2014- SGR-1051)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D1.2 First release of the softwares

  • Tosi, Riccardo
  • Amela Milian, Ramon
  • Núñez Corbacho, Marc
  • Roig Pina, Carlos Alejandro
  • Badia Sala, Rosa Maria
  • Rossi, Riccardo
This deliverable presents the software release of the Kratos Multiphysics software [3], ”a framework for building parallel, multi-disciplinary simulation software, aiming at modularity, extensibility, and high performance. Kratos is written in C++, and counts with an extensive Python interface”. In this deliverable we focus on the development of Uncertainty Quantification inside Kratos. This takes place in the MultilevelMonteCarloApplication, a recent development inside the software that allows to deal with uncertainty quantification., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación

ExaQUte: D2.3. Adjoint-based error estimation routines

  • Keith, Brendan
  • Apostolatos, Andreas
  • Kodakkal, Anoop
  • Rossi, Riccardo
  • Tosi, Riccardo
  • Wohlmuth, Barbara
This document presents a simple and ecient strategy for adaptive mesh refinement (AMR) and a posteriori error estimation for the transient incompressible Navier{Stokes equations. This strategy is informed by the work of Prudhomme and Oden [22, 23] as well as modern goal-oriented methods such as [5]. The methods described in this document have been implemented in the Kratos Multiphysics software and uploaded to https://zenodo.org [27].1 This document includes: A review of the state-of-the-art in solution-oriented and goal-oriented AMR. The description of a 2D benchmark model problem of immediate relevance to the objectives of the ExaQUte project. The definition and a brief mathematical summary of the error estimator(s). The results obtained. A description of the API., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A stabilised displacement–volumetric strain formulation for nearly incompressible and anisotropic materials

  • Rossi, Riccardo
  • Zorrilla Martínez, Rubén
  • Codina, Ramon
The simulation of structural problems involving the deformations of volumetric bodies is of paramount importance in many areas of engineering. Although the use of tetrahedral elements is extremely appealing, tetrahedral discretisations are generally known as very stiff and are hence often avoided in typical simulation workflows. The development of mixed displacement–pressure approaches has allowed to effectively overcome this problem leading to a class of locking-free elements which can effectively compete with hexahedral discretisations while retaining obvious advantages in the mesh generation step. Despite such advantages the adoption of the technology within commercial codes is not yet pervasive. This can be attributed to two different reasons: the difficulty in making use of standard constitutive libraries and the implied continuity of the pressure, which makes the application of the method questionable in the context of multi-material problems. Current paper proposes the adoption of the volumetric strain instead of the pressure as a nodal value. Such choice leads to the definition of a modified strain making the use of standard strain-driven constitutive laws straightforward. At the same time, the continuity of the volumetric strain across multimaterial interfaces can be understood as a sort of kinematic constraint (stresses can still remain discontinuous across material interfaces). The new element also opens the door to the use of anisotropic constitutive laws, which are typically problematic in the context of mixed elements., This research has been partly supported by the European Commission (EC) through the project ExaQUte (H2020-FETHPC-2016-2017-800898). The authors also acknowledge financial support from the Spanish Ministry of Economy and Competitiveness, through the “Severo Ochoa Programme for Centres of Excellence in R& D” (CEX2018-000797-S). R. Codina acknowledges the support received from the ICREA Acadèmia Research Program, from the Catalan Government ., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Linking ghost penalty and aggregated unfitted methods

  • Badia, Santiago
  • Miranda Neiva, Eric
  • Verdugo Rojano, Francesc
In this work, we analyse the links between ghost penalty stabilisation and aggregation-based discrete extension operators for the numerical approximation of elliptic partial differential equations on unfitted meshes. We explore the behaviour of ghost penalty methods in the limit as the penalty parameter goes to infinity, which returns a strong version of these methods. We observe that these methods suffer locking in that limit. On the contrary, aggregated finite element spaces are locking-free because they can be expressed as an extension operator from well-posed to ill-posed degrees of freedom. Next, we propose novel ghost penalty methods that penalise the distance between the solution and its aggregation-based discrete extension. These methods are locking-free and converge to aggregated finite element methods in the infinite penalty parameter limit. We include an exhaustive set of numerical experiments in which we compare weak (ghost penalty) and strong (aggregated finite elements) schemes in terms of error quantities, condition numbers and sensitivity with respect to penalty coefficients on different geometries, intersection locations and mesh topologies., This research was partially funded by the Australian Government through the Australian Research Council (project number DP210103092), the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme and the projects RTI2018-096898-B-I00 and ERC2018-092843 from the “FEDER/Ministerio de Ciencia e Innovación – Agencia Estatal de Investigación”. F. Verdugo acknowledges support from the Spanish Ministry of Economy and Competitiveness through the “Severo Ochoa Programme for Centers of Excellence in R&D (CEX2018-000797-S)”. F. Verdugo acknowledges support from the Secretaria d’Universitats i Recerca of the Catalan Government, Spain in the framework of the Beatriu Pinós Program (Grant Id.: 2016 BP 00145). This work was also supported by computational resources provided by the Australian Government through NCI under the National Computational Merit Allocation Scheme., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

An embedded approach for the solution of the full potential equation with finite elements

  • Núñez Corbacho, Marc
  • Lopez, Iñigo
  • Baiges Aznar, Joan
  • Rossi, Riccardo
Recent developments in numerical simulations in the aerodynamics field are focused on reducing the computational cost of the solvers, targeting their use at the initial design steps. Under the right assumptions, potential solvers can be exploited to accomplish a valid solution of the flow field for streamlined bodies in subsonic and close to transonic flows. A fully embedded approach to solve the full-potential equation is presented, where both the geometry and the wake are defined implicitly with a level set function. Embedded methods allow simplifying the mesh generation process, as only a background mesh is required to perform the analysis. The presented method gives an automatic and fast option to solve subsonic flows, which is especially desirable in optimization workflows., This work has been supported by the European Commission through the Horizon 2020 Research and Innovation program under contract 800898 (ExaQUte project). The authors also acknowledge financial support from the Spanish Ministry of Economy and Competitiveness , through the “Severo Ochoa Programme for Centres of Excellence in R&D” (CEX2018-000797-S)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Robust high-order unfitted finite elements by interpolation-based discrete extension

  • Badia, Santiago
  • Miranda Neiva, Eric
  • Verdugo Rojano, Francesc
In this work, we propose a novel formulation for the solution of partial differential equations using finite element methods on unfitted meshes. The proposed formulation relies on the discrete extension operator proposed in the aggregated finite element method. This formulation is robust with respect to the location of the boundary/interface within the cell. One can prove enhanced stability results, not only on the physical domain, but on the whole active mesh. However, the stability constants grow exponentially with the polynomial order being used, since the underlying extension operators are defined via extrapolation. To address this issue, we introduce a new variant of aggregated finite elements, in which the extension in the physical domain is an interpolation for polynomials of order higher than two. As a result, the stability constants only grow at a polynomial rate with the order of approximation. We demonstrate that this approach enables robust high-order approximations with the aggregated finite element method. The proposed method is consistent, optimally convergent, and with a condition number that scales optimally for high order approximation., This research was partially funded by the Australian Government through the Australian Research Council (project number DP210103092), the European Commission under the FET-HPC ExaQUte project (Grant agreement ID: 800898) within the Horizon 2020 Framework Programme and the project RTI2018-096898-B-I00 from the “FEDER/Ministerio de Ciencia e Innovación (MCIN) – Agencia Estatal de Investigación (AEI)”. F. Verdugo acknowledges support from the “Severo Ochoa Program for Centers of Excellence in R&D (2019-2023)” under the grant CEX2018-000797-S funded by MCIN/AEI/10.13039/501100011033. This work was also supported by computational resources provided by the Australian Government through NCI under the National Computational Merit Allocation Scheme., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Solution of Navier–Stokes equations on a fixed mesh using conforming enrichment of velocity and pressure

  • Tanyildiz, Deniz Cagri
  • Martí, Julio Marcelo
  • Rossi, Riccardo
The final publication is available at Springer via http://dx.doi.org/10.1007/s40571-019-00285-6, Simulation of fluid flows of multi-materials is an intriguing topic in computational mechanics. Capturing the physics of the interface between different materials poses a challenge because of the discontinuities that may occur on the interface. Several methods have been proposed in the literature to deal with this issue. In this paper, a technique based on Nitsche’s method has been employed on a fixed mesh combined with the PFEM-2 strategy for the solution of Navier–Stokes equations on multi-fluid flows. The novelty of this technique is its capability of capturing the strong and weak discontinuities and its compatibility for the application of various types of boundary conditions on the interface., The research that has been presented in this publication and the results obtained have been conducted and achieved with the support of the Ministerio de Economía y Competitividad (MINECO) from Spain and its funding program Ayudas para Contratos Predoctorales para la Formación de Doctores (ref. BES-2014-070613). Author Deniz C. Tanyildiz would like to express special thanks to the project: PARFLOW (ref. BIA2013-49007-C2-1-R). Dr. Riccardo Rossi would like to express special thanks to the project: EXAQUTE (ref. 800898). Moreover, the authors would like to express their gratitude to Dr. Joan Baiges from Polytechnical University of Catalonia, for his substantial help on Nitsche’s method., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A parallel dynamic asynchronous framework for uncertainty quantification by hierarchical Monte Carlo algorithms

  • Tosi, Riccardo
  • Amela Milian, Ramon
  • Badia Sala, Rosa Maria
  • Rossi, Riccardo
The necessity of dealing with uncertainties is growing in many different fields of science and engineering. Due to the constant development of computational capabilities, current solvers must satisfy both statistical accuracy and computational efficiency. The aim of this work is to introduce an asynchronous framework for Monte Carlo and Multilevel Monte Carlo methods to achieve such a result. The proposed approach presents the same reliability of state of the art techniques, and aims at improving the computational efficiency by adding a new level of parallelism with respect to existing algorithms: between batches, where each batch owns its hierarchy and is independent from the others. Two different numerical problems are considered and solved in a supercomputer to show the behavior of the proposed approach., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 800898. This work has been supported by the Spanish Government (contracts SEV2015- 0493 and TIN2015-65316-P), by the Generalitat de Catalunya (contract 2014-SGR-1051). The authors thankfully acknowledge the computer resources at MareNostrum and the technical support provided by Barcelona Supercomputing Center (IM-2020-1-0016)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A generic finite element framework on parallel tree-based adaptive meshes

  • Badia, Santiago
  • Martín, Alberto F.
  • Miranda Neiva, Eric
  • Verdugo Rojano, Francesc
In this work we formally derive and prove the correctness of the algorithms and data structures in a parallel, distributed-memory, generic finite element framework that supports h-adaptivity on computational domains represented as forest-of-trees. The framework is grounded on a rich representation of the adaptive mesh suitable for generic finite elements that is built on top of a low-level, light-weight forest-of-trees data structure handled by a specialized, highly parallel adaptive meshing engine, for which we have identified the requirements it must fulfill to be coupled into our framework. Atop this two-layered mesh representation, we build the rest of the data structures required for the numerical integration and assembly of the discrete system of linear equations. We consider algorithms that are suitable for both subassembled and fully assembled distributed data layouts of linear system matrices. The proposed framework has been implemented within the FEMPAR scientific software library, using p4est as a practical forest-of-octrees demonstrator. A strong scaling study of this implementation when applied to Poisson and Maxwell problems reveals remarkable scalability up to 32.2K CPU cores and 482.2M degrees of freedom. Besides, a comparative performance study of FEMPAR and the state-of-the-art deal.II finite element software shows at least comparative performance, and at most a factor of 2--3 improvement in the h-adaptive approximation of a Poisson problem with first- and second-order Lagrangian finite elements, respectively., Financial support from the European Commission under the EMUSIC and ExaQUteprojects within the Horizon 2020 Framework Programme is gratefully acknowledged (grants 690725and 800898, resp.). This work has been partially funded by the project RTI2018-096898-B-I00from the “FEDER/Ministerio de Ciencia e Innovación–Agencia Estatal de Investigación”. The firstauthor gratefully acknowledges the support received from the Catalan Government through theICREA Acadèmia Research Program. The third author gratefully acknowledges the support receivedfrom the Catalan Government through an FI fellowship (2019 FI-B2-00090; 2018 FI-B1-00095; 2017FI-B-00219). The fourth author gratefully acknowledges the support received from the Secretariad’Universitats i Recerca of the Catalan Government in the framework of the Beatriu Pinós Program(grant 2016 BP 00145). The authors thankfully acknowledge the computer resources at Marenostrum-IV and the technical support provided by the Barcelona Supercomputing Center (RES-ActivityID:FI-2018-2-0009, FI-2018-3-0029, IM-2020-1-0002)., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The aggregated unfitted finite element method on parallel tree-based adaptive meshes

  • Badia, Santiago
  • Martín, Alberto F.
  • Miranda Neiva, Eric
  • Verdugo Rojano, Francesc
In this work, we present an adaptive unfitted finite element scheme that combines the aggregated finite element method with parallel adaptive mesh refinement. We introduce a novel scalable distributed-memory implementation of the resulting scheme on locally adapted Cartesian forest-of-trees meshes. We propose a two-step algorithm to construct the finite element space at hand by means of a discrete extension operator that carefully mixes aggregation constraints of problematic degrees of freedom, which get rid of the small cut cell problem, and standard hanging degree of freedom constraints, which ensure trace continuity on nonconforming meshes. Following this approach, we derive a finite element space that can be expressed as the original one plus well-defined linear constraints. Moreover, it requires minimum parallelization effort, using standard functionality available in existing large-scale finite element codes. Numerical experiments demonstrate its optimal mesh adaptation capability, robustness to cut location, and parallel efficiency, on classical Poisson hp-adaptivity benchmarks. Our work opens the path to functional and geometrical error-driven dynamic mesh adaptation with the aggregated finite element method in large-scale realistic scenarios. Likewise, it can offer guidance for bridging other scalable unfitted methods and parallel adaptive mesh refinement., This work was supported by the European Commission under the FET-HPC ExaQUte project (grant 800898) within the Horizon 2020 Framework Programme and the project RTI2018- 096898-B-I00, by the Barcelona Supercomputing Center (RES-ActivityID: FI-2019-1-0007, IM-2019- 2-0007, IM-2019-3-0008), and by the Australian Government. The work of the third author was supported by the Catalan Government through an FI fellowship (2019 FI-B2-00090, 2018 FI-B1- 00095, 2017 FI-B-00219). The work of the fourth author was supported by the Spanish Ministry of Economy and Competitiveness through the “Severo Ochoa Programme for Centers of Excellence in R&D (CEX2018-000797-S)” and Secretaria d’Universitats i Recerca of the Catalan Government in the framework of the Beatriu Pinós Program (grant 2016 BP 00145)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Subdomain deflation combined with local AMG: a case study using AMGCL library

  • Demidov, D.
  • Rossi, Riccardo
The final publication is available at Springer via http://dx.doi.org/10.1134/S1995080220040071, The paper proposes a combination of the subdomain deflation method and local algebraic multigrid as a scalable distributed memory preconditioner that is able to solve large linear systems of equations. The implementation of the algorithm is made available for the community as part of an open source AMGCL library. The solution targets both homogeneous (CPU-only) and heterogeneous (CPU/GPU) systems, employing hybrid MPI/OpenMP approach in the former and a combination of MPI, OpenMP, and CUDA in the latter cases. The use of OpenMP minimizes the number of MPI processes, thus reducing the communication overhead of the deflation method and improving both weak and strong scalability of the preconditioner. The examples of scalar (single degree of freedom per grid node), Poisson-like, systems as well as non-scalar problems, stemming out of the discretization of the Navier-Stokes equations, are considered in order to estimate performance of the implemented algorithm. A comparison with a traditional global AMG preconditioner based on a well-established Trilinos ML package is provided., Contribution of Dr. Demidov was funded by the state assignment to the Joint Supercomputer Center of theRussian Academy of Sciences for Scientific Research and Russian Foundation for Basic Research, grant no. 18-07-00964. Dr. Rossi acknowledges the financial support to CIMNE via the CERCA Programme/Generalitat de Catalunya and the support of the ExaQUte FetHPC, project GA 800898. The authors thankfully acknowledge the support of the PRACE program (project 2010PA4058), in providing access to the MareNostrum 4 and PizDaint clusters. Without such resources the testing would not have been possible. The help of Prof. Labarta of the POP Center of Excellence in improving the NUMA scalability of the solver is also gratefully acknowledged., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

An embedded Finite Element framework for the resolution of strongly coupled Fluid–Structure Interaction problems: application to volumetric and membrane-like structures

  • Zorrilla Martínez, Rubén
  • Rossi, Riccardo
  • Wüchner, Roland
  • Oñate Ibáñez de Navarra, Eugenio
This work presents a Fluid–Structure Interaction framework for the robust and efficient simulation of strongly coupled problems involving arbitrary large displacements and rotations. We focus on the application of the proposed tool to lightweight membrane-like structures. Nonetheless, all the techniques we present in this work can be applied to both volumetric and volumeless bodies. To achieve this, we rely on the use of embedded mesh methods in the fluid solver to conveniently handle the extremely large deflections and eventual topology changes of the structure. The coupling between the embedded fluid and mechanical solvers is based on an interface residual black-box strategy. We validate our proposal by solving reference benchmarking examples that consider both volumetric and volumeless geometries. Whenever it is possible, we also compare the embedded solution with the one obtained with our reference body fitted solver. Finally we present a real-life application of the presented embedded Fluid–Structure Interaction solver., This research has been partly supported by the International Graduate School of Science and Engineering, Germany (IGSSE) and the European Commission (EC) through the projects ATMOPACE and ExaQUte (H2020-FETHPC-2016-2017-800898). The authors also acknowledge financial support from the Spanish Ministry of Economy and Competitiveness , through the “Severo Ochoa Programme for Centres of Excellence in R&D” (CEX2018-000797-S). Rubén Zorrilla gratefully acknowledges the support of the Spanish ministry of Science, Innovation and Universities for his FPU grant (FPU15/03796)., Peer Reviewed, Postprint (author's final draft)