Simulation-Based Inference and Unbinned Asimov Construction with Hybrid Neural Density Estimation
Rafael Coelho Lopes de Sa, Jay Sandesara
Abstract
High-dimensional, unbinned neural simulation-based inference often relies on neural ratio estimation, which uses expressive supervised models to estimate density ratios, but a learned ratio by itself provides neither an explicit normalized density nor a generative model. Flow-based surrogate models instead enable tractable density evaluation and efficient sampling, but residual density-estimation errors can limit precision for complex implicit distributions. We propose hybrid neural density estimation, which uses a flow to define a parameter-independent reference distribution, and classifiers to estimate target-to-reference density ratios. Multiplying a learned ratio by the reference density gives an evaluable target density surrogate. The ratio also provides importance weights for integration and resampling. We show how this representation defines an exact Asimov dataset, whose maximum likelihood fit returns the generating parameters. We also show how the tractable reference supplies renewable samples for pseudo-experiments and how it enables methods to reduce the Monte Carlo variance of expected test statistic calculations. We demonstrate the construction in a toy statistical model motivated by high-energy physics measurements, but for which the exact densities are known analytically.
Create a lesson
Related papers
Data geometry preserves prediction but reshapes explanation
Nicola Amoroso, Mario Caruso, Marianna La Rocca et al.
Developing Multi-Dimensional, Sequential sWeighting Routines for Reaction Selection with Emphasis on Kaon Identification at CLAS12
A. Acar, M. Bashkanov, D. P. Watts et al.
Attributing extreme-event probability to a source variable
Daniel F. T. Hagan
β-Oslo and Shape analyses with unresolved parent-state mixtures
Yangping Shen
Constrained surrogates for arbitrary families of continuous probability distributions
Jack Murdoch Moore, Eduardo G Altmann
Online local learning for generative thermodynamic computing
Huilin Wang, Weibing Deng