Testing for trends in online experiments
Chris Haulk, Lee Richardson, Jacopo Soriano
Abstract
Time-varying treatment effects can be estimated with linear regression paired with jackknife confidence intervals. In experiments at a large online video platform, the test based on this estimator is not much less powerful than modern tests for monotonic trends. If you suspect trends in your online experiments, consider using this estimator.
Create a lesson
Related papers
Statistical Inference for Probability Barycenters and Kolmogorov Moments
Manuela-Simona Cojocea
Non-Invariance in Nested Prediction Models under Selective Predictor Availability
Marc Delord
Quantum mutual information statistics for detecting dependence-structure change points in time series
Jiwon Kang, Yun Am Seo
Off-policy causal estimation in networks
Sahil Loomba, Dean Eckles
Reconciling Interpretability with Covariate-Dependent Shape Flexibility in Penalized Transformation Models for Distributional Regression
Johannes Brachem, Thomas Kneib
Detecting Early and Late Divergences in Survival Curves Using Nonparametric Effect Measures
Patrick B. Langthaler, Jun Ma, Jonas Beck