Index-Free Dynamic Edge Retrieval with Energy-Tail-Aware Partial Scans
Mohammad Arif Rasyidi, Omar Alhussein
Abstract
Dynamic maximum inner-product search (MIPS) returns the K stored vectors with the largest dot products with a query while allowing the dataset to change through insertions, replacements, and deletions. For edge retrieval, the challenge is to achieve high recall and fast queries without making updates expensive. Full-vector scanning keeps updates simple but compares each query with every stored vector, while indexed methods reduce query cost at the expense of maintaining additional structures during updates. We propose ETAR, an index-free method that reduces query work while preserving simple updates. ETAR keeps the query coordinates with the largest squared values until they cover most of its total squared magnitude and treats the rest as a low-magnitude tail. It estimates similarity from the retained coordinates using a compact lower-precision representation, corrects for skipped coordinates, and reranks a fixed number of candidates using full-precision vectors. Across five runs on nine static datasets, ETAR averages 99.2% Recall@10, the fraction of exact top-10 results recovered, while running over 4× faster than exact scanning at a representative setting. This speedup also extends to an ARM-based mobile device, where ETAR is up to 6.9× faster across four synthetic distributions. Under five streaming workloads, it maintains 100% Recall@10 at every measured point without index rebuilds. Overall, ETAR offers a practical middle ground for dynamic MIPS by reducing query cost while retaining simple, index-free updates. Code is available at https://github.com/arasyi/etar-mips.
Create a lesson
Related papers
Incremental Pooled LLM Evaluation for Cost-Effective Retrieval Model Selection
Max Nelson, Hanoz Bhathena, Aviral Joshi et al.
Recommender System as Slow and Fast Thinkers
Zichen Yuan, Xiaoxuan Dong, Linkun Dai et al.
Training seeds and model-selection stability in recommender-system evaluation
Juan Manuel Rodriguez, Oleg Lesota, Antonela Tommasel
ViSAR: Training-Free Adaptive-k Retrieval for Visual Document Question Answering
Adrien Mialland, Marc Plantevit, Julien Gallois et al.
Adaptive Test-Time Inference for Text2Cypher with Trace Budgeting and Selective Refinement
Makbule Gulcin Ozsoy
Counter-GEO-Bench: Evaluating Defenses Against Information-Distorting Generative Engine Optimization
Bing Zheng, Zongyao Zhao, Wenming Yang