Executable verification through formalized expert reasoning in astronomical spectroscopy

Abstract

Artificial intelligence has reshaped scientific prediction, but scientific verification remains a human bottleneck. Automated systems can map observations to labels, parameters or hypotheses, yet scientific conclusions require evidence, must satisfy physical consistency, and need explicit testing of alternatives before a decision is made. Here we introduce FORMA (Formalized Observational Reasoning with Auditable Decisions), an executable verification protocol that reconstructs expert reasoning into a workflow: it extracts evidence, generates hypotheses under physical constraints, tests alternatives, and performs auditable consistency checks. Unlike prediction or post-hoc interpretability, executable verification records and tests the evidential path leading to a decision. Astronomical spectroscopy provides a natural testbed, because ambiguous survey spectra are still adjudicated by expert visual inspection. Applied to the Dark Energy Spectroscopic Instrument (DESI) visual inspection catalogue, FORMA combines template-fitting candidate redshifts, spectral evidence extraction and physical audit into an auditable credibility score. A medium-or-higher credibility threshold identifies $331$ definite predictions with $95.5\%$ binary agreement with expert-adjudicated classes, while increasing credibility is associated with improved redshift consistency and higher classification reliability. These results show that automated inference can be coupled to explicit verification, allowing candidate outputs to be evaluated before they enter scientific use.