Learnable Hodge-Laplacian Driven Mixture of Experts for Steady-PDE Surrogates on Coarse Unstructured Meshes
Stavros Nousias, Akis Nousias, Konstantinos Gkrispanis
Abstract
Current approaches for steady partial differential equations surrogate models on unstructured meshes apply a single mixing mechanism to the whole solution. This paper proposes an architecture that partitions the solution among vanilla transformer experts, each focused on a different spectral scale. The partition is built from a discrete Hodge Laplacian L0=0-1 d01 d0, that serves as a fitting layer measuring high-frequency content. A gating mechanism takes the mesh as input and produces the per-vertex weights that recombine the expert outputs. AirFRANS is a steady Reynolds-averaged Navier--Stokes (RANS) airfoil benchmark. We evaluate our approach in a reduced remeshed version of the benchmark with each unstructured mesh counting 9.6K faces and 4.9K vertices. We compare our approach with the Transolver on the same dataset and dataset slit. Our approach reduces relative L2 error by 31\% and interior mean squared error by 47\%.
Create a lesson
Related papers
Your Transformer Is Secretly Elastic
Walter Simoncini, Dheeraj Varghese, Gertjan J. Burghouts et al.
Continuum Attention
Afshin Khadangi
One Task, Many Interfaces: Simple Cross-Interface Consistency Training Improves LLM Agent Robustness
Artin Tajdini, Manpreet Kaur, Peng Qi
Recovering Reliable Supervision via Critique-Guided On-Policy Distillation
Kaixiang Zhao, Tianrun Yu, Shangzhe Li et al.
Detection of Potato Plant Leaf Diseases using Convolutional Neural Networks
Haimanot Bitew Alemayehu, Simachew Melaku Ayalew, Chilotie Desalew Mengesha et al.
Revisiting Simple Baselines for Relational Deep Learning
Viet The Nguyen, Vijay Prakash Dwivedi, Gunther Gust