A Tidy Data Structure and Visualisations for Multiple Variable Correlations and Other Pairwise Scores
Abstract
We provide a pipeline for calculating, managing and visualising correlations and other pairwise association scores for numerical and categorical data. We present a uniform interface for calculating a plethora of pairwise scores and propose a tidy data structure for organising the results. We also provide new visualisations which simultaneously show multiple and/or grouped pairwise scores. The visualisations are far richer than a traditional heatmap of correlation scores, as they help identify relationships with categorical variables, numeric variable pairs with non-linear associations or those which exhibit Simpson's paradox. These methods are available in our R package bullseye.
Turn this paper into a full lesson
ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.