COVE: A Task-Adaptive, Code-Based Ensemble for Proactive Verification of LLM Outputs
Anjaney Shrivastava, Dharmala Hrudai Aditya
Abstract
Large Language Models (LLMs) are now embedded in enterprise workflows, yet their outputs remain prone to hallucinations: plausible-sounding but factually incorrect or malformed content. Most verification approaches are reactive, detecting errors only after generation and often spending additional expensive LLM calls to do so. We present COVE, a task-adaptive, code-based ensemble that takes the opposite stance: it prevents errors before generation and validates structure and consistency afterwards using six deterministic, pure-Python innovations that add no extra LLM calls. On an internal evaluation spanning 11 text datasets (1,020 examples) and 4 image datasets (200 examples), COVE lifts text accuracy from a 45.2% unverified baseline to 82.1% (an 81.7% relative improvement), improves image accuracy by 69.5%, and reduces token usage by 48 to 96% (simulated cost model), at a measured verification overhead of 0.26 ms per output (excluding the LLM call). This article describes the engineering design of each innovation (with pseudocode and the exact parameters we use), the measured impact, an ablation of every component, and the practical lessons learned from deploying code-based verification in enterprise pipelines.
Create a lesson
Related papers
Are We Just Applying LLMs? What SE Research Studies, Underexplores, and Could Do Next in the LLM Era
Zeinadsadat Saghi, Sadra Sabouri, Souti Chattopadhyay
Testing Processor Contracts in Speculative Decoding Engines
Tianyu Ding, Yaocheng Tong, Muzhi Yang et al.
Supporting Viewpoint Coordination for Compliance by Design with an Artifact Model for Regulatory Requirements Engineering
Oleksandr Kosenkov, Davide Fucci, Michael Unterkalmsteiner et al.
DistDebug-Bench: Can LLM Agents Diagnose Bugs in Distributed Systems?
Yuxuan Jiang, Chenglin Liu, John Rose et al.
uTECH Turbo-MOVES: The Intersection of Software Architectural Innovation and Sustainable Mobility Analysis
Cafer Avcı, Alireza Yazdiani, Roopak Srinivasan et al.
Specification-Driven Governance for Fairness-by-Design in Agentic Software Engineering: How Far Can We Go?
Alfonso Cannavale, Alessandra Parziale, Valeria Pontillo et al.