Mitigating warp divergence in GPU optical photon Monte Carlo: an order of magnitude speedup with Shader Execution Reordering
Gabor Galgoczi
Abstract
In high energy, nuclear, and medical physics, optical photon transport Monte Carlo is a frequent bottleneck in detector simulation. GPU ray tracing accelerates photon propagation, but one thread per photon megakernels suffer from SIMT execution divergence when photon lifetimes vary widely. Short-lived photons leave inactive lanes while a few long-lived photons delay warp completion. We evaluate NVIDIA Shader Execution Reordering (SER) in an OptiX based optical photon transport kernel and use it to regroup surviving photons during propagation. In a 14.7 kton liquid argon time projection chamber benchmark with ~61 million photons from a 2.5 GeV electromagnetic shower, SER capable execution reduces propagation kernel cycles by 16.55(23)x and end-to-end optical simulation time, including transfers and initialization, by 14.72(30)x with bit-identical hit output. We decouple the speed-up into a 3.2x contribution from the launch configuration changes introduced when SER is enabled and a further 5.1x from executing the reorder. Profiling identifies active lane recovery as the dominant mechanism, while branch efficiency and memory bandwidth change little. A volume coherent SER hint enables an analytic navigation fast path in bulk argon, adding a further 1.13x wall-time speedup. Utilizing SER resulted in a ~90% reduction in GPU energy per simulated event.
Create a lesson
Related papers
Design and performance of the Fast Beam Condition Monitor for luminosity and background measurement at the CMS Experiment in LHC Run 3
The CMS BRIL Collaboration, Eliana Acurio, Ying An et al.
AlGaN/GaN Hall-Effect Sensor for In-Situ Magnetic Field Monitoring of the HSX Stellarator
Yiming Zhao, Wayne Goodman, Thomas Gallenberger et al.
Measuring and Modelling Lag in Amorphous Silicon Flat-Panel X-ray Detectors
Yiyue Huang, Benjamin Young, Andrew Kingston et al.
Signal formation and induction-gap optimization in a THGEM coupled to a resistive plate anode
Arpan Maity, Luca Moleri, Maryna Borysova et al.
Development and Commissioning of the Cryogenic Target Detectors for the Technical Run of the NUCLEUS Experiment
N. Schermer, H. Abele, G. Angloher et al.
Aliased noise characterization and mitigation in BICEP Array 150, 220 and 270 GHz time-division multiplexed detectors
S. Fatigoni, P. A. R. Ade, Z. Ahmed et al.