Think Thrice Before Reranking: Multi-perspective Evidence and Reasoning Integration for Text Reranking
Lijun Liu, Zhengzong Chen, Wenyan Li, Yuanyuan Zhao, Fei Huang
Abstract
Reasoning-based reranking with Large Language Models (LLMs) has shown promising improvements in text ranking. However, current methods predominantly rely on a single reasoning trajectory, resulting in rankings that are susceptible to reasoning errors and inherently constrained in modeling the multifaceted signals underlying document relevance. To resolve this dilemma, we propose MERIT-Rank(Multi-perspective Evidence and Reasoning Integration for Text Reranking), a framework that models complementary reasoning trajectories to improve reranking robustness. MERIT-Rank formulates a Multi-Trajectory Reasoning Space (MTRS) that evaluates query-document relevance from multiple perspectives and introduces a joint reranker that consolidates these reasoning paths into a unified ranking decision. We further develop Progressive Rank Policy Optimization (PRPO), a progressive training framework that stabilizes reasoning trajectories while continually improving ranking quality through staged optimization objectives. Experiments on both reasoning-intensive and traditional retrieval benchmarks show that MERIT-Rank consistently achieves superior performance over competitive baselines. The 4B model notably outperforms most 7B and even 32B rerankers on BRIGHT.
Create a lesson
Related papers
Reasoning Quality Matters: Combating Reasoning Collapse in LLM-based Embedding Learning
Zihan Gong, Xiaohan Ye, Jiangchao Yao et al.
The Missing Complement: State-Conditioned Minimal Sufficient Evidence for Coding Agents
Zhexi Feng, Ruiyi Zhang, Yongbo Yang et al.
Reproducing Transparent and Scrutable Recommendations: Exploring Open-Weight Models via Natural-Language User Profiles
Noah Mamié, Laurin van den Bergh
Dense Feature Representation over Sequence Modeling: A Solution to the KDD Cup 2026 UniRec Challenge
Yi Zhang, Weiliang Ji
Self-Evolving Search Index
Sangam Lee, Wonjae Lee, Sunghwan Kim et al.
Beyond Similarity through Zero-Token Geometric Graphs for Multi-Hop RAG
Zeliang Li, Xiaofen Xing, Kailing Guo et al.