Recent benchmarks in the Analysis Grand Challenge and integration with Combine (and HS3)

Abstract

The Analysis Grand Challenge (AGC) showcases an example of HEP analysis. Its reference implementation uses modern Python packages to realize the main steps, from data access to statistical model building and fitting. The packages used for data handling and processing (coffea, uproot, awkward-array) have recently undergone a series of performance optimizations. While not being part of the HEP Python (PyHEP) ecosystem, the Combine tool is a pillar of CMS analyses, covering more than 90% of the analyses published in the last few years. As such, it is necessary to have Combine integrated in the PyHEP ecosystem, using the AGC as example. This project also includes, in the long-term, providing support and integration for the High Energy Physics Statistics Serialization Standard (HS3), as a way to have a language-independent way of representing the likelihood and use different frameworks interchangeably. In these proceedings we cover part of the recent work performed on the AGC and Combine, including: performance benchmarks, covering benefits introduced by the recent improvements in the data processing packages; examples of how Combine can be integrated and run in a dedicated infrastructure (coffea-casa); and examples and plans to integrate HS3 in Combine.