UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Performance and accuracy analysis of nonlinear k-Wave simulations using local domain decomposition with an 8-GPU server

Treeby, BE; Vaverka, F; Jaros, J; (2018) Performance and accuracy analysis of nonlinear k-Wave simulations using local domain decomposition with an 8-GPU server. In: Proceedings of the 21st International Symposium on Nonlinear Acoustics. (pp. 022002). Acoustical Society of America: Santa Fe, Mexico, USA. Green open access

[thumbnail of CONF_37_2018_Treeby_ISNA_KinslerLDD.pdf]
Preview
Text
CONF_37_2018_Treeby_ISNA_KinslerLDD.pdf - Published Version

Download (3MB) | Preview

Abstract

Large-scale nonlinear ultrasound simulations using the open-source k-Wave toolbox are now routinely performed using the MPI version of k-Wave running on traditional CPU-based clusters. However, the all-to-all communications required by the 3D fast Fourier transform (FFT) severely impact performance when scaling to large numbers of compute cores. This can be overcome by using a domain decomposition strategy based on a local Fourier basis. In this work, we analyze the performance and accuracy of using local domain decomposition for running a high-intensity focused ultrasound (HIFU) simulation in the kidney on a single server containing eight NVIDIA P40 graphical processing units (GPUs). Different decompositions and overlap sizes are investigated and compared to a global MPI simulation running on a CPU-based supercomputer using 1280 cores. For a grid size of 960 by 960 by 1280 grid points and an overlap size of 4 grid points, the error in the simulation using local domain decomposition is on the order of 0.1$ compared to the global simulation, which is sufficient for most applications. The financial cost for running the simulation is also reduced by more than an order of magnitude.

Type: Proceedings paper
Title: Performance and accuracy analysis of nonlinear k-Wave simulations using local domain decomposition with an 8-GPU server
Event: 21st International Symposium on Nonlinear Acoustics
Open access status: An open access version is available from UCL Discovery
DOI: 10.1121/2.0000883
Publisher version: https://doi.org/10.1121/2.0000883
Language: English
Additional information: This version is the version of record. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Med Phys and Biomedical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10061757
Downloads since deposit
52Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item