GLiDE: A Fast, Calibrated Decision Model Distilled from Reasoning Teachers
Sahibzada Allahyar, Julia White, Dhruv Atreja, George Hurn-Maloney, Urchade Zaratiana
Abstract
Decision models enable fast, confidence-aware decisions by scoring candidate answers in a single forward pass, without generating text or intermediate reasoning. Yet reasoning can substantially improve decision quality, raising the question of whether its benefits can be retained without the cost of generating it. We investigate this question with GLiDE, a family of decision models spanning 0.4B to 27B parameters. Building on Qwen hybrid language models, GLiDE enables bidirectional interactions between the context, question, and candidate answers by removing causal masking from full-attention layers. To transfer reasoning capabilities into single-pass inference, we combine soft-target distillation from multiple teachers, including a reasoning model, with progressive post-training on diverse decision tasks. We further explore parameter-free recurrent depth to increase inference-time computation without generating tokens. Across five model sizes, GLiDE lies on the performance--parameter Pareto frontier of the Hugging Face , with each model outperforming evaluated alternatives of equal or smaller size. (27B) achieves a hidden-set score of 71.52, with an expected calibration error of 2.0\% and a median latency of 92.9\,ms on a single GPU. Further checkpoint averaging and parameter-free recurrent depth yield GLiDE~27B, which reaches 73.37 with an expected calibration error of 2.1\%.
Create a lesson
Related papers
PlayCraft: Designing Engaging Games from Agent Play Experience
Weihao Cheng
Probing the "Conscious" Mind: Selective Access and Global Workspace in Vision-Language Models
Jiahao Huang, Jun Wang
ProtoDiffusion: Token-per-Layer Generative Modeling of Multi-Layer Images
Adrià Ciurana Lanau, Harleen Hanspal, Lusine Abrahamyan et al.
MM-SystemOneBias: Evaluating Bias in Multimodal Jev-Style System One Decision Models
Jinzhe Li, Qi Wang, Dandan Guo et al.
The Geometry of Lies: Knowledge and Persona Directions for Detecting Deception in Large Language Models
Md. Abdullah Al Zami, Suraiya Shanaz, Mahdi Hasan et al.
LLM GerryMandering: Separating Interactions from Additive Effects in LLM Audits
George Rahul, Ronit Jahilal, Bhaskara Hanuma Vedula et al.