GPU-MPI parallelisation for QuickPIC, a three-dimensional quasi-static particle-in-cell algorithm

QuickPIC is a quasi-static PIC program for simulating plasma wakefield acceleration. It supports a hybrid parallel simulation on multiple central processing units via OpenMP and message passing interface (MPI). We now present a version of QuickPIC that runs on graphics processing units (GPU), with MPI for communication between different GPUs, based on the UCLA Parallel Partice-In-Cell framework. By rewriting relevant Fortran77 functions with CUDA C, we port the two-dimensional particle and field computations onto GPU platforms. QuickPIC-GPU supports simulation with a single GPU for up to a resolution of 1024 cubed <mml:math xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mnf="http://cambridge.org/core/manifest" xmlns:cup="http://contentservices.cambridge.org" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:m="http://cambridge.org/core/metadata" xmlns:core="http://cambridge.org/core" xmlns:c="http://cambridge.org/core/content"> <mml:msup> <mml:mn>1024</mml:mn> <mml:mn>3</mml:mn> </mml:msup> </mml:math> $1024^3$ and 25 particles per cell to avoid time spent on cross-processor communications, and simulation with multiple GPUs for larger problem sizes.