Interpretational errors in statistical causal inference

Abstract

We formalize an interpretational error that is common in statistical causal inference, termed identity slippage. This formalism is used to describe historically-recognized fallacies, and analyse a fast-growing literature in statistics and applied fields. We conducted a systematic review of natural language claims in the literature on stochastic mediation parameters, and documented extensive evidence of identity slippage in applications. This framework for error detection is applicable whenever policy decisions depend on the accurate interpretation of statistical results, which is nearly always the case. Therefore, broad awareness of identity slippage will aid statisticians in the successful translation of data into public good.