How Evaluation Choices Change the Measured Benefit of Cooperative Perception: Evidence from Three V2X Benchmarks
Pincan Zhao, Yili Tang, Xinrui Zhang
Abstract
Cooperative perception, in which connected vehicles and roadside infrastructure share sensor information, is a candidate enabler of automated mobility, and benchmark accuracy is the evidence cited when roadside deployment is considered. This paper audits that evidence base across one simulated and two real-world vehicle-to-everything (V2X) benchmarks. In simulation, two widely studied robustness axes leave almost no recoverable headroom: an infrastructure-anchored pose correction returns about one accuracy point at every error level, and corrupting a partner costs 0.7 points. On real data, measurement choices govern the conclusion. An apparent seventeen-fold advantage of infrastructure in partner-poor frames falls below four-fold once the split is broadened, and an ad-hoc class definition measures a far smaller benefit than the official protocol reports. Cooperation is worth 7 to 15 accuracy points, yet 27% of frames on one split offer no partner and almost none do on another, so every regime-conditioned claim must name its split.
Create a lesson
Related papers
RipplePLM: Structural and Property Decoupling for Protein Mutation Effect Generation
Liuzhenghao Lv, Yuyang Liu, Yuyang Gao et al.
CODesign: Consistency from Data to Trajectory in All-Atom Protein Binder Co-Design
Yuanle Mo, Bo Qiang, Haitao Lin et al.
A pyramidal ISRU lunar habitat design based on topological interlocking of sintered regolith blocks
Lukas Schnelle, Kai-Uwe Schröder, Alice C. Niemeyer et al.
From language-model stock rankings to testable economic rules: A computational audit
Shuai Wu, Xue Li, Zhijun Wang et al.
Names without information: Attention allocation and rent transfer in a zero-fundamental token market
Dingding Cao, Han Wang, Yujing Zhong et al.
Trusting the Inverse: Reliability-Aware Mapping for Simulation-Based Microstructure Estimation in Diffusion MRI
Juan Luis Villarreal Haro, Ileana Jelescu, Jean-Philippe Thiran et al.