Concise network models of memory dynamics reveal explainable patterns in path data

Abstract

Networks are a powerful tool to model the structure and dynamics of complex systems across scales. Direct connections between system components are often represented as edges, while paths and walks capture indirect interactions. This approach assumes that flows in the system are sequences of independent transitions. Path data from real-world systems often have higher-order dependencies, which require more sophisticated models. In this work, we propose a method to construct concise networks from path data that interpolate between first and second-order models. We prioritise simplicity and interpretability by creating state nodes that capture latent modes of second-order effects and introducing an interpretable measure to balance model size and accuracy. In both synthetic and real-world applications, our method reveals large-scale memory patterns and constructs concise networks that provide insights beyond the first-order model at the fraction of the size of a second-order model.