LightBridge: Feed-Forward Generative Relighting for 3D Gaussian Splatting
Hezhi Cao, Panhao Cheng, huangsheng du, Qibiao Li, Youcheng Cai, Ligang Liu
Abstract
3D Gaussian Splatting (3DGS) achieves high-quality, real-time novel view synthesis, but the resulting assets have baked-in illumination and cannot be easily relit. Inverse rendering methods optimize simplified reflectance and illumination models for each scene, limiting efficiency and relighting quality. Recent generative approaches leverage large diffusion models for realistic lighting edits, but applying them to 3DGS typically requires an additional per-scene optimization stage to bake the edited appearance into the representation. We present LightBridge, a feed-forward generative framework for controllable relighting of complete 3DGS assets in a single pass. To enable feed-forward training, we construct a large-scale Multi-Illumination Relighting Dataset with paired source and target observations of the same scenes. Latent Bridge Relighting Diffusion models relighting as source-to-target transport in latent space, enabling one-step extraction of 2D visual tokens without iterative diffusion sampling. A Gaussian Propagation Transformer uses a point transformer with sparse image-to-point self-attention followed by point-to-image cross-attention to efficiently propagate these cues across the complete 3DGS, while avoiding full attention over all image and Gaussian tokens. Experiments validate these designs, demonstrating competitive relighting quality and efficient single-pass prediction of complete relit 3DGS assets without scene-specific optimization. The code and dataset will be made publicly available upon acceptance.
Create a lesson
Related papers
Projective Affine Body Dynamics for Multibody Systems
Zimeng Ye, Xiaowei He, Yuzhong Guo et al.
Telligram: Text-Driven Calligram Generation via Diffusion-Guided Skeleton Optimization
Tianci Shi, Pengfei Xu
WildFab: Multi-Axis 3D Printing from Models in the Wild
Jiasheng Qu, Zhikai Shen, Chenyu Xu et al.
MeshSplatBench: A Unified Benchmark for Triangle-Based Neural Rendering
Kaixuan Zhang, Minxian Li, Mingwu Ren et al.
HyperSketch: Controllable Video Sketching in a Style Hyperspace
Xinding Zhu, Xinye Yang, Yingping Yang et al.
Inverse Rig Optimization from Line Drawings
Zihao Zhu, Yuki Koyama