kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Towards adaptive mesh refinement for the spectral element solver Nek5000
KTH, School of Engineering Sciences (SCI), Mechanics. (Linné flow centre)ORCID iD: 0000-0002-1724-0188
KTH, School of Engineering Sciences (SCI), Centres, Linné Flow Center, FLOW.ORCID iD: 0000-0002-7448-3290
Show others and affiliations
2017 (English)Report (Refereed)
Abstract [en]

Hypre, a library for linear algebra, is used to replace a Matlab code for performing the setup step of an Algebraic Multigrid Method (AMG). The AMG method is used to compute part of the preconditioner in Nek5000, a code for Computational Fluid Dynamics based on the spectral element method. However, the solution of the AMG problem is not performed via Hypre but by Nek5000’s internal solver. The new AMG setup is shown to be faster by at least one order of magnitude, while it does not significantly impact the efficiency of the AMG solver, as is shown from its application to relevant test cases.

Place, publisher, year, edition, pages
2017. , p. 6
National Category
Fluid Mechanics
Research subject
Engineering Mechanics
Identifiers
URN: urn:nbn:se:kth:diva-217497OAI: oai:DiVA.org:kth-217497DiVA, id: diva2:1156589
Note

QC 20171123

Available from: 2017-11-13 Created: 2017-11-13 Last updated: 2025-02-09Bibliographically approved
In thesis
1. Towards adaptive mesh refinement in Nek5000
Open this publication in new window or tab >>Towards adaptive mesh refinement in Nek5000
2017 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

The development of adaptive mesh refinement capabilities in the field of computational fluid dynamics is an essential tool for enabling the simulation of larger and more complex physical problems. While such techniques have been known for a long time, most simulations do not make use of them because of the lack of a robust implementation. In this work, we present recent progresses that have been made to develop adaptive mesh refinement features in Nek5000, a code based on the spectral element method. These developments are driven by the algorithmic challenges posed by future exascale supercomputers. First, we perform the study of the strong scaling of Nek5000 on three petascale machines in order to assess the scalability of the code and identify the current bottlenecks. It is found that strong scaling limit ranges between 5, 000 and 220, 000 degrees of freedom per core depending on the machine and the case. The need for synchronized and low latency communication for efficient computational fluid dynamics simulation is also confirmed. Additionally, we present how Hypre, a library for linear algebra, is used to develop a new and efficient code for performing the setup step required prior to the use of an algebraic multigrid solver for preconditioning the pressure equation in Nek5000. Finally, the main objective of this work is to develop new methods for estimating the error on a numerical solution of the Navier–Stokes equations via the resolution of an adjoint problem. These new estimators are compared to existing ones, which are based on the decay of the spectral coefficients. Then, the estimators are combined with newly implemented capabilities in Nek5000 for automatic grid refinement and adaptive mesh adaptation is carried out. The applications considered so far are steady and two-dimensional, namely the lid-driven cavity at Re = 7, 500 and the flow past a cylinder at Re = 40. The use of adaptive mesh refinement techniques makes mesh generation easier and it is shown that a similar accuracy as with a static mesh can be reached with a significant reduction in the number of degrees of freedom.

Place, publisher, year, edition, pages
KTH Royal Institute of Technology, 2017. p. 140
Series
TRITA-MEK, ISSN 0348-467X ; 2017:18
Keywords
Error estimators, mesh refinement, adaptivity, spectral element method, algebraic multigrid method
National Category
Fluid Mechanics
Research subject
Engineering Mechanics
Identifiers
urn:nbn:se:kth:diva-217501 (URN)978-91-7729-616-4 (ISBN)
Presentation
2017-12-11, E3, Kungliga Tekniska Högskolan, Osquars Backe 14, Stockholm, 10:15 (English)
Opponent
Supervisors
Funder
Knut and Alice Wallenberg FoundationSwedish National Infrastructure for Computing (SNIC)EU, Horizon 2020, 671571
Note

QC 20171114

Available from: 2017-11-14 Created: 2017-11-13 Last updated: 2025-02-09Bibliographically approved
2. Aspects of adaptive mesh refinement in the spectral element method
Open this publication in new window or tab >>Aspects of adaptive mesh refinement in the spectral element method
2019 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

This thesis deals with the improvement of the efficiency of numerical simulations in computational fluid dynamics. Some of the limitations of current algorithms on future exascale supercomputers are addressed with the main goal of using adaptive mesh refinement for the simulation of turbulent and three-dimensional flows. The comparison between two different error estimators is also investigated.The framework considered all throughout this thesis is Nek5000, a highly parallel code based on the spectral element method.

First, the strong parallel scaling of Nek5000 is studied on three petascale machines in order to assess the scalability of the code and identify the current bottlenecks. It is found that the strong scaling limit ranges between 5,000 and 220,000 gridpoints per core depending on the machine and the case. The need for synchronized and low latency communication for fast computations is confirmed. It is also shown that, on a single core, Nek5000 is memory limited rather than compute limited.

Then, a new method for the coarse grid part of the preconditioner for the pressure equation is implemented, which represents a significant improvement compared to existing solvers. We use an algebraic multigrid method from the Hypre library to perform the setup and solver parts on the fly and fully in parallel. The setup phase only amounts to a few percents of the wall clocktime for a single timestep of the solver and is therefore negligible; this is a requirement for adaptive simulations, where the setup must be performed after each adaptation. In addition, the new solver is shown to be suitable for large and complex simulations in three dimensions.

Finally, the main objective of this work is to perform simulations with adaptive mesh refinement to achieve error control and efficient use of computational resources. We develop adjoint error estimators based on the dual-weighted residuals method and also consider more traditional a posteriori error indicators for comparison. Adaptive simulations are performed on test cases of increasing complexity: the steady flow in a lid-driven cavity in 2D and 3D, the steady flow past a 2D cylinder and the turbulent flow inside a constricted periodic channel in 3D. It is concluded that adjoint error estimators are preferred for flows with a strongly convective nature, while the more straightforward spectral error indicators are sufficient otherwise. Moreover, we perform an adaptive simulation of the turbulent flow past a NACA4412 profile at Reynolds number Re = 850,000, using the spectral error indicators. In comparison to cases with a fixed mesh, the aspect ratio of grid elements in the far field remains low, the convergence of the pressure solver is significantly sped up and the much larger computational domain allows true free-stream boundary conditions and thus makes the results less dependent on the boundary conditions.

Abstract [sv]

Den här avhandlingen syftar till att utveckla metoder för att öka effektiviteten av strömningsmekaniska simuleringar. Arbetet visar också vissa begränsningarna hos nuvarande algoritmer om de ska användas på framtida superdatorer i exaskala. Adaptiv nätförfining används i den här avhandlingen för att simulera tredimensionella turbulenta strömningar. Dessutom jämförs två stycken olika metoder för att uppskatta felet av lösningen till Navier–Stokes ekvationer. Hela arbetet baseras på koden Nek5000, som använder den spektrala elementmetoden. Inledningsvis undersöker vi den starka parallela skalbarheten av Nek5000 på tre superdatorer i petaskala för att bedöma kodens skalbarhet och identifiera befintliga flaskhalsar. Det visas att den starka skalningen per kärna för koden är begränsad till mellan 5, 000 och 220, 000 frihetsgrader, beroende på superdator och fall. Det är även bekräftat att synkroniserad kommunikation medliten fördröjning är nödvändigt för att uppnå effektiva strömningsmekaniska simuleringar. Nek5000 är minnesbegränsat på en enskild kärna. Sedan implementeras en ny metod som förbättrar förkonditioneringen av tryckequationen på den grova delen av nätet. Vi använder en algebraisk flernätsmetod från Hypre för att automatiskt sätta upp lösningsmatriserna och lösa algoritmen på parallella datasystemer. Tiden som krävs för att initiera ett tidsteg är försumbar jämfört med beräkningstiden; det här är ett krav för adatiptiva simuleringar som behöver initiera efter varje adaption av nätet.Dessutom bekräftas det att den nya lösaren är lämplig för att simulera stora och komplexa tredimensionella strömningsproblem.

Huvudsyftet med arbetet att utföra simuleringar med adaptiva nätförfiningar för att kunna kontrollera felet på lösningen och att effektivt använda beräkningsresurser. Vi utvecklar adjunkta feluppskattningar baserat på dubbelviktade residualmetoden och jämför också med traditionella metoder som uppskattar felet av lösningen i efterhand (eng. spectral error indicators). Adaptiva nätförfiningssimuleringar genomförs på testfall som blir mer och mer komplexa: en stationär strömning i en kavitet med en rörlig rand (eng. lid-driven cavity) både två- och tredimensionellt, stationärt flöde kring en tvådimensionell cylinder och turbulent tredimensionell kanalströmningen i en periodisk domän.Slutsatsen är att adjunkta feluppskattningar föredras för flöden där konvektion dominerar, medan traditionella metoder för att uppskatta felet är tillräckligt bra för alla andra fall. Vi genomför även en adaptiv simulering av det turbulenta flödet över en NACA4412 vingprofil vid ett Reynoldstal Re = 850, 000, där vi använder traditionella metoder för att uppskatta felet. Resultaten från simuleringen har jämförts med simuleringar på ett nät utan adaptiv förfining, slutsatsen är en snabbare konvergens för att lösa ekvationen för trycket och att resultaten blir mindre beroende av randvillkoren på grund av en större domän,som tillåter korrekta friströmsrandvillkor.

Place, publisher, year, edition, pages
KTH Royal Institute of Technology, 2019. p. 206
Series
TRITA-MEK, ISSN 0348-467X ; 2019:28
Keywords
Error estimators, mesh refinement, adaptivity, spectral element method, algebraic multigrid method, NACA4412, periodic hill case.
National Category
Fluid Mechanics
Research subject
Engineering Mechanics
Identifiers
urn:nbn:se:kth:diva-251638 (URN)978-91-7873-223-4 (ISBN)
Public defence
2019-06-12, F3, Kungliga Tekniska Högskolan, Lindstedtsvägen 26, Stockholm, 10:15 (English)
Opponent
Supervisors
Note

QC20190517

Available from: 2019-05-16 Created: 2019-05-16 Last updated: 2025-02-09Bibliographically approved

Open Access in DiVA

fulltext(72 kB)717 downloads
File information
File name FULLTEXT01.pdfFile size 72 kBChecksum SHA-512
8194ac717d412fa76864f814c92fe2f90569bde87af4767a95c6eefa55e860bc5607d723bd42fc80d9e82ada8369ad781c713c64572d8fd7ef3826fed11dbd96
Type fulltextMimetype application/pdf

Authority records

Offermans, NicolasPeplinski, AdamSchlatter, Philipp

Search in DiVA

By author/editor
Offermans, NicolasPeplinski, AdamSchlatter, Philipp
By organisation
MechanicsLinné Flow Center, FLOW
Fluid Mechanics

Search outside of DiVA

GoogleGoogle Scholar
Total: 718 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 463 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf