The False Discovery Rate (FDR) of Multiple Tests in a Class Room Lecture

Abstract

Multiple tests are designed to test a whole collection of null hypotheses simultaneously. Their quality is often judged by the false discovery rate (FDR), i.e. the expectation of the quotient of the number of false rejections divided by the amount of all rejections. The widely cited Benjamini and Hochberg (BH) step up multiple test controls the FDR under various regularity assumptions. In this note we present a rapid approach to the BH step up and step down tests. Also sharp FDR inequalities are discussed for dependent p-values and examples and counter-examples are considered. In particular, the Bonferroni bound is sharp under dependence for control of the family-wise error rate.