Adaptive Algorithms in Finite Forms
I. Y. Tyukin, D. V. Prokhorov, Cees van Leeuwen
Abstract
We propose a new method to design adaptation algorithms that guarantee a certain prescribed level of performance and are applicable to systems with nonconvex parameterization. The main idea behind the method is, given the desired performance characteristics and a class of nonlinearly parameterized systems, first to augment the tuning error function and design the adaptation scheme in the form of ordinary differential equations. The resulting augmentation is allowed to depend on state derivatives. To deal with these, we suggest the realization of the adaptation scheme in an algebraic-integral form. Because of the explicit dependance on the state of the original system such adaptation schemes are referred to as adaptive algorithms in it finite form instead of differential ones. Sufficient conditions for the existence of finite form realizations are proposed. These conditions lead to the necessity to find a solution of a system of partial differential equations, which in general is not an easy task. In order to resolve this problem we suggest to embed the original system dynamics into one of a higher order, thus replacing it by a simple integration of a function with respect to a single scalar argument. Several full-state feedback finite form realizations are presented and illustrated with examples.
Create a lesson
Related papers
Risk-Sensitive Stochastic Optimal Control on Positive Cones
Mohamad Al Ahdab, John-Josef Leth
Deterministic Oracle Complexity for Goldstein Stationarity in Nonsmooth Nonconvex Optimization with Constraints
Yixi Ding, Ya-xiang Yuan
Technical Report: Partially Asynchronous Distributed Optimization on Riemannian Manifolds
Adam Pooley, William Warke, Matthew T. Hale
Multi-Step Performance Estimation for Gradient Descent under the Polyak Lojasiewicz Condition
Wanli Hong, Shuyang Ling
Robust Markov Decision Processes: An Introduction Using Convex Optimization and Game Theory
Julien Grand-Clément
Dual-Mode Extremum Seeking for Diffusion Systems with Boundary-Cost Feedback
Martin Guay, Denis Dochain