Recursive multivariate derivatives of ef(x1,…, xn) of arbitrary order
Abstract
High-order derivatives of nested functions of a single variable can be computed with the celebrated Fa\`a di Bruno's formula. Although generalizations of such formula to multiple variables exist, their combinatorial nature generates an explosion of factors, and when the order of the derivatives is high, it becomes very challenging to compute them. A solution is to reuse what has already been computed, which is a built-in feature of recursive implementations. Thanks to this, recursive formulas can play an important role in Machine Learning applications, in particular for Automatic Differentiation. In this manuscript we provide a recursive formula to compute multivariate derivatives of arbitrary order of ef(x1,…,xn) with respect to the variables xi. We note that this method could also be beneficial in cases where the high-order derivatives of a function f(x1,…,xn) are hard to compute, but where the derivatives of (f(x1,…,xn)) are simpler.
Turn this paper into a lesson
ArcXiv compiles a structured reading guide from this paper's metadata: plain-English importance, contributions, prerequisite concepts, which sections to read first, flashcards, and a quiz. Grounded in the abstract, never invented.