Library for 2D pencil decomposition and distributed Fast Fourier Transform |
DSTAR is a high-order code for Direct Simulation of Turbulence And Reaction, initially developed by Professor Kai Luo (Southampton University) and extended by co-workers over the past 20 years. It solves the complete Navier-Stokes equations as well as conservation equations for energy and chemical species. Modules for both direct numerical simulation (DNS) and large eddy simulation (LES) have been developed for high-fidelity simulation of turbulence, aeroacoustics, turbulent combustion, multiphase turbulent flow and combustion. DSTAR incorporates highly accurate numerical techniques such as 6th-order spatial discretisation, non-reflecting boundary conditions and low-storage Runge-Kutta explicit time-advancement.
Parallel algorithms include MPI and mixed MPI/OpenMP. The domain decomposition for parallel operations can be carried out in 1D or 2D using the 2DECOMP&FFT library. In this case, only the decomposition API is required. The code solves compressible equations and there is no tricky Poisson problem to solve. The code has been run successfully using 6144 cores in pure MPI mode and 18432 cores in hybrid mode on HECToR.
A typical scientific application is shown below:
The mathematical framework of DSTAR is described in details in:
Details of the parallelisation was reported at the 2011 Cray User Group conference.