Scalable Inversion of Contests with Correlated Performances, Including Softmax and Multinomial Probit
Peter Cotton
Abstract
Multinomial probit choice probabilities over n alternatives are Gaussian orthant integrals, computed by simulation for thirty years, one expensive integral per alternative. Inversion, which is to say determining item attractiveness consistent with a prescribed choice probability vector, is even more difficult and has been considered impractical for correlated contests when n is large. Yet here, for families lying within a grammar including factor, block and hierarchical covariance structures, we exhibit a calibration tested at n = 1,000,000 reproducing probabilities to very high accuracy, even in the extreme tail. We must return to much smaller problems for any performance comparison to be possible due to limitations of the prior art. The Geweke-Hajivassiliou-Keane simulator is the standard (and still appropriate for high rank) but is two hundred times slower already at n = 200, and its measured cost grows roughly as n2.8 while ours is linear. Furthermore our approach applies to any continuous performance distributions within reason: the Thurstone-Mosteller model families thereby become a practical alternative to logit at modern scale.
Create a lesson
Related papers
Statistical Inference for Probability Barycenters and Kolmogorov Moments
Manuela-Simona Cojocea
Non-Invariance in Nested Prediction Models under Selective Predictor Availability
Marc Delord
Quantum mutual information statistics for detecting dependence-structure change points in time series
Jiwon Kang, Yun Am Seo
Off-policy causal estimation in networks
Sahil Loomba, Dean Eckles
Reconciling Interpretability with Covariate-Dependent Shape Flexibility in Penalized Transformation Models for Distributional Regression
Johannes Brachem, Thomas Kneib
Detecting Early and Late Divergences in Survival Curves Using Nonparametric Effect Measures
Patrick B. Langthaler, Jun Ma, Jonas Beck