Layer-wise Lipschitz-Product Control for Deep Kolmogorov--Arnold Network Representations of Compositionally Structured Functions

Abstract

We prove that any continuous function f from [0,1]n to R representable by a finite computation tree with N internal nodes and compositional sparsity s = O(1) admits a deep Kolmogorov-Arnold Network (KAN) representation. Each internal node is realised by a primitive KAN block with controlled block depth and Lipschitz product. The layer-wise Lipschitz product satisfies the primary domain-sensitive bound independent of the input dimension n. It simplifies to P(KANf) <= max(C*,1)Lf with Lf <= cmax * N. For the standard operations +,-,x,sin,cos with x nodes on [0,1]-bounded inputs we obtain P(KAN) <= 1. Layer widths satisfy nl <= n + 2 wmax * N. The uniform approximation error is bounded by N * max(C*,1)d(f) * epsilonOp (simplifies when C* <=1). For f in Cm we obtain optimal B-spline rates. Range bounds are also derived (Bf <= N+1 for additive trees). This addresses the gap on Lipschitz control in deep KAN stacks noted by Liu et al. (2024). Experiments confirm P(KAN)=1.0 for several compositionally structured functions.

0

Turn this paper into a lesson

ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.

Discussion (0)

Sign in to join the discussion.

Loading comments…