GAMER-2: a GPU-accelerated adaptive mesh refinement code - accuracy, performance, and scalability

Journal
Date Issued
2018
Author(s)
Schive, Hsi-Yu
•
ZuHone, John A.
•
Goldbaum, Nathan J.
•
Turk, Matthew J.
•
•
Cheng, Chin-Yu
DOI
Abstract
We present GAMER-2, a GPU-accelerated adaptive mesh refinement (AMR) code for astrophysics. It provides a rich set of features, including adaptive time-stepping, several hydrodynamic schemes, magnetohydrodynamics, self-gravity, particles, star formation, chemistry, and radiative processes with GRACKLE, data analysis with YT, and memory pool for efficient object allocation. GAMER-2 is fully bitwise reproducible. For the performance optimization, it adopts hybrid OpenMP/MPI/GPU parallelization and utilizes overlapping CPU computation, GPU computation, and CPU-GPU communication. Load balancing is achieved using a Hilbert space-filling curve on a level-by-level basis without the need to duplicate the entire AMR hierarchy on each MPI process. To provide convincing demonstrations of the accuracy and performance of GAMER-2, we directly compare with ENZO on isolated disc galaxy simulations and with FLASH on galaxy cluster merger simulations. We show that the physical results obtained by different codes are in very good agreement, and GAMER-2 outperforms ENZO and FLASH by nearly one and two orders of magnitude, respectively, on the Blue Waters supercomputers using 1-256 nodes. More importantly, GAMER-2 exhibits similar or even better parallel scalability compared to the other two codes. We also demonstrate good weak and strong scaling using up to 4096 GPUs and 65 536 CPU cores, and achieve a uniform resolution as high as 10240^3 cells. Furthermore, GAMER-2 can be adopted as an AMR + GPUs framework and has been extensively used for the wave dark matter simulations. GAMER-2 is open source (available at https://github.com/gamer-project/gamer) and new contributions are welcome.
Volume
481
Issue
4
Start page
4815
Uri
Url
Issn Identifier
0035-8711
Ads BibCode
2018MNRAS.481.4815S
Rights
open.access
File(s)
Loading...
Thumbnail Image
Name

sty2586.pdf

Description
pdf editoriale
Size

7.78 MB

Format

Adobe PDF

Checksum (MD5)

a21a2a7ce7667a56da19a0fbe63bda52