PrismStencil: Transforming Stencil Computations into Matrix Multiplications
Xianmeng Jiang, Yuan Liang, Zixuan Wang, Kun Li, Yunquan Zhang
Abstract
Stencil computations are a fundamental class of workloads in scientific and engineering applications. Although Tensor Cores offer new opportunities for stencil acceleration, existing tensorization methods suffer from substantial redundant computation and insufficient data reuse. We propose PrismStencil, a stencil tensorization algorithm that introduces a novel mapping scheme between matrices and stencil grid points. PrismStencil employs multidimensional vector mapping to accommodate the multidimensional data dependencies of stencil computations and a unified gather--scatter tensorization scheme to exploit the relative sizes of the matrix dimensions in Tensor Core operations, thereby reducing the redundant computation introduced by tensorization. Moreover, it introduces a cross-product data-reuse mechanism that exploits the overlap among neighboring stencil updates to further enhance data reuse. Across representative stencil kernels on an NVIDIA A100 GPU, PrismStencil achieves average speedups of 2.13x and 2.17x over state-of-the-art Tensor Core stencil methods with FP64 and TF32 precision, respectively.
Create a lesson
Related papers
How the Dirty Set Moves: Characterizing Schedule Reuse in Incremental Sparse Matrix Multiplication
Hunter Horne, Eric Spencer, Alex Henningfield et al.
Fast and Flexible Spiking Network Simulations on Massively Distributed On-Chip Memory Accelerators
Catherine Mia Schöfmann, Jan Finkbeiner, Jan Vogelsang et al.
How Reliable Are Large Language Models for Soil Organic Carbon Assessment? An Australian Benchmark
Yingxuan Cheng, Tong Li, Yayong Li et al.
AlignPred: Error-Controlled KV Cache Compression via Alignment and Predictive Coding
Xu Yang, Jiapeng Zhang, Zhiwei Zuo et al.
DynaSPLIT: Strong tail-optimal scheduling for the M/G/n with heavy-tailed job sizes
Zhouzi Li, Mor Harchol-Balter, Alan Scheller-Wolf
Compositional Performance Modeling of LLM Inference Clusters with Hierarchical KV Caching
Ruiyang Ma, Sheng Qi, DaiKang Kuang et al.