CELEBI: Design and Realization of a Reproducible Physics Analysis Framework

Abstract

Reproducibility in modern physics analysis requires more than preserving source code or workflow descriptions. Analyses evolve through changes in code, configurations, parameters, input datasets, and dependencies, requiring a coherent representation of both the analysis and the provenance of its results. We present Celebi, a framework for organizing and preserving evolving physics analyses while keeping analysis definitions lightweight and separate from generated data products. Celebi maintains analysis definitions and preserved states in an Analysis Repository, while execution and generated results are managed separately through a Production Factory. The middleware layer, Yuki, connects preserved analysis states to execution infrastructure by constructing executable Snakemake workflows and dispatching them to supported runners, keeping the analysis representation independent of execution backends. This paper presents three main design concepts. First, the workflow architecture provides a modular representation of analysis components and their dependencies. Second, a structured file organization realizes this model in a human-readable form, separating reusable algorithms, task-specific configurations, parameters, documentation, and dependencies into well-defined objects. Third, the impression mechanism preserves immutable states of these objects and their dependencies, assigning persistent identities to specific analysis configurations and linking generated results unambiguously to their originating states. Together, these concepts establish a coherent representation of evolving physics analyses, supporting reproducibility, provenance tracking, collaboration, and long-term preservation.