DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning
Qihang Cao, Haoyuan Li, Zihan Guo, Sensen Gao, Zihui Gao, Huixin Zhang, Fan He, Jianhua Han, Hang Xu, Xiaodan Liang, Jia-Wang Bian
Abstract
Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D. However, we find that existing models struggle to excel at both: 3D post-training can weaken dynamic understanding, while 4D-specialized models often lack strong static 3D reasoning. Our analysis reveals that this spatial--dynamic interference is highly non-uniform across parameter groups, with the balance between static and dynamic capabilities particularly sensitive to changes in late-layer MLPs. To address this interference, we propose DynThinker, a unified framework for jointly strengthening static and dynamic spatial reasoning. Decoupled Exponential Moving Average (D-EMA) applies configurable group-wise averaging to constrain drift in interference-sensitive pretrained parameters while preserving flexibility for capability enhancement. Spatial-Dynamic Fusion (SDF) complements D-EMA by selectively integrating spatial and temporal priors from a dynamic geometry encoder into intermediate VLM representations under semantic guidance. Across ten metrics spanning nine static 3D and dynamic 4D benchmarks, DynThinker achieves the highest average score among all evaluated models. Notably, DynThinker achieves 56.0 on ReVSI, 67.2 on DSR-Bench, and 51.2 and 40.1 under the sample-wise and group-wise evaluation protocols of DSI-Bench, respectively, setting new state-of-the-art results among the compared open-source models across all four evaluations within a unified model.
Create a lesson
Related papers
Can Learning to Answer Spatial Questions Improve Novel-View Generation?
Jahyeok Koo, Hyeonseo Yu, Seungho Jang et al.
Representation Conditioning for Generation
Saeed Razavi, Xingjian Leng, Liang Zheng
VITAL: From Visual Motion to Precise Action
Ao Liang, Youquan Liu, Mingxiao Li et al.
CommerceGen-Studio: An End-to-End Framework for Commercial-Grade Main-Image Generation
Xiaoli Xu, Zhengtao Wu, Zhengze Xu et al.
GeoThinker-F: Endogenous Predictive World Representations for Fast Spatial Intelligence
Haoyuan Li, Qihang Cao, Huanyuan Zhou et al.
Feed-Forward Multi-View Feature Coding for 3D Gaussian Splatting
Seungmi Choi, Ji-Hyoun Choi, Suhyun Jo et al.