Statistics in the Age of AI
Juan Sosa, Brenda Betancourt
Abstract
Artificial intelligence (AI) can automate programming, model fitting, visualization, simulation, literature synthesis, and increasingly sophisticated methodological tasks, but it cannot remove the logical conditions under which data support scientific claims or consequential decisions. We formalize these conditions through statistical warrant, which connects data to a claim through the target, observation regime, assumptions, procedure, uncertainty assessment, validation criterion, loss structure, governance and accountability. No algorithm can consistently recover a target that is not identified by the observation regime without additional information or assumptions. From this principle, we organize the argument around five statements. Questions and targets are integral to statistical methods. Data acquire evidential meaning only through design, provenance, and assumptions. Description, prediction, causal inference, and decision are mathematically distinct tasks. Analytical abundance requires accounting for how analyses are selected, uncertainty across the analytical system, and deployment validation. The statistician's fundamental role is therefore to construct, criticize, and safeguard statistical warrant, including by developing new methodology when existing theory is inadequate. This role requires statistical reasoning and attributable human and institutional responsibility.
Create a lesson
Related papers
Statistical Theory in the Age of Machine-Assisted Mathematics: Rethinking How Theory Is Made and Taught
Pietro Coretto
Statistical Leadership of What? Statistics After AI
Anders Gorst-Rasmussen
When to take one box, when to take two: A concrete analysis of Newcomb's problem
Radford M. Neal
Algorithms for optimizing model-based incomplete block designs
Jonas Bjermo, Frank Miller
Data Assimilation: Addressing Spurious Correlations and Scalability Issues
Eric Crislip, Moe Khalil, Kyle Neal
Becoming Good Stewards of Information: A framework for integrating ethical, civic, and professional formation throughout the statistics and data science curriculum
Kaitlyn G Fitzgerald