Community detection for binary graphical models in high dimension

Abstract

Let N components be partitioned into two communities, denoted P+ and P-, possibly of different sizes. Assume that they are connected via a directed and weighted Erd\"os-R\'enyi (DWER) random graph with unknown parameter p ∈ (0, 1). The weights assigned to the existing connections are of mean-field-type, scaling as N-1. At each time step, we observe the state of each component: either it sends some signal to its successors (in the directed graph) or remains silent otherwise. In this paper, we show that it is possible to find the communities P+ and P- based only on the activity of the N components observed over T time units. More specifically, we propose two simple methods, an aggregated method and a spectral method, whose misclassification rates vanish as long as T N (up to log terms). This condition is proved to be near-optimal in the minimax sense. Moreover, under the stronger condition T N2 (up to log terms), the aggregated method is shown to achieve exact recovery with probability tending to 1. Interestingly, these simple methods do not require any prior knowledge of the other model parameters (e.g. the edge probability p). The key step in our analysis is to derive an asymptotic approximation of the 1-lagged covariance matrix associated to the states of the N components, as N diverges. This asymptotic approximation relies on the study of the behavior of the solutions of a Stein-type matrix equation satisfied by the simultaneous (0-lagged) covariance matrix associated to the states of the components. This study is challenging, especially because the simultaneous covariance matrix is random since it depends on the underlying DWER random graph.

0

Turn this paper into a full lesson

ArcXiv compiles a staged curriculum from this paper: 8-12 lessons across beginner → advanced, synthesised section guides, visuals, flashcards, a quiz, exercises, and on-demand deep dives per section. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…