Adaptive Geometric Regression for High-Dimensional Structured Data

Abstract

We present a geometric framework for regression on structured high-dimensional data that shifts the analysis from the ambient space to a geometric object capturing the data's intrinsic structure. The method addresses a fundamental challenge in analyzing datasets with high ambient dimension but low intrinsic dimension, such as microbiome compositions, where traditional approaches fail to capture the underlying geometric structure. Starting from a k-nearest neighbor covering of the feature space, the geometry evolves iteratively through heat diffusion and response-coherence modulation, concentrating mass within regions where the response varies smoothly while creating diffusion barriers where the response changes rapidly. This iterative refinement produces conditional expectation estimates that respect both the intrinsic geometry of the feature space and the structure of the response.