CACO: Coverage-Aware Coordinated Optimization for Continuous Generative Retrieval
Pan Zhang, Nan Zhuang, Yongkang Zhang, Kun Xú, Zhongtao Jiang, Zhiwei Wang, Kun Xǔ, Youhuan Li
Abstract
Continuous generative retrievers powered by flow matching and diffusion sample multiple queries in item embedding space for parallel approximate nearest-neighbor (ANN) search under fixed retrieval budgets. However, optimizing distribution diversity or target-level interest separation ignores set-level retrieval geometry: sampled queries collapse onto overlapping ANN neighborhoods, while discrete top-K lookup and single-target supervision block end-to-end coverage optimization. We introduce CACO (Coverage-Aware Coordinated Optimization), a lightweight self-supervised post-training framework that coordinates queries from frozen flow-matching and diffusion retrievers toward complementary item coverage with negligible additional inference latency. CACO uses empirical retrieval frequencies across sampled reference queries as a relevance proxy, formulating a label-free coverage objective that improves recall across all 30 backbone-dataset settings in offline greedy selection experiments. To avoid the inference overhead of generating a large query pool, CACO employs a coordinated query adjustment network that combines inter-query bidirectional attention with gated relative directions, finally updating queries by bounded tangent-space projection and spherical retraction. During training, CACO applies tangential antithetic perturbations and measures each query's marginal gain via counterfactual single-query replacement, yielding an unbiased gradient estimator of smoothed set coverage across non-differentiable ANN search. On eight public benchmarks and an in-house 24-partition streaming industrial dataset, CACO improves Recall@100 by up to 23.7% and Recall@400 by up to 23.9% over the strongest baseline, cuts inter-query overlap by 53.3%-64.9%, and adds only 0.5%-3.0% inference latency.
Create a lesson
Related papers
Cost-Aware Agentic Feature Optimization System for Fleet-Scale Ranking Models
Chang Yang, Yao Xuan, Wendan Yan et al.
Democratizing Cross-Project Knowledge for Transforming Water Governance and Climate Resilience: an Agentic AI Ecosystem
Oriol Alàs, Ian Palacín, Iván Cester et al.
From Sessions to Serving: Integrating LLM-Based Embeddings into Retrieval for Production Content Recommendation
Zhixiong Hu, Meng Li, Maggie Zhang et al.
A Task-Level Bias Taxonomy for Historical Image Retrieval
Omkar Gavali, Ratan Sebastian, Christoph Rippe et al.
LINEAGE: A Benchmark for Empirical Lineage Retrieval in AI Scientific Literature
Pangjing Wu, Xu Yuan, Wenqi Fan et al.
Can LLMs Resolve Entity Conflicts in Domain Specific NLU Pipelines?
Akansha Bhardwaj, Mingbo Cui, Victor Guimaraes et al.