Been Down So Long it Looks Like Up to Me: A Unified Derivation of Conjugate Gradient and Variable Metric Minimization
R. A. Hyman, Bridget Doporcyk, John Tetzlaff
Abstract
Simple derivations, at a level appropriate for an undergraduate computational physics course, of the most popular methods for finding the minimum of a function of many variables are presented in a unified manner in the context of a general optimization scheme that emphasizes their essential similarities. The derivations in this paper encompass the conjugate gradient methods with and without conditioning, and the variable metric methods. The common variants of these methods including Fletcher-Reeves, Polak-Ribiere, Davidon-Fletcher-Powell, and Broyden-Fletcher-Goldfarb-Shanno are described and motivated.
Create a lesson
Related papers
Physical-state supervision for design-only Gaussian process surrogates of implosion simulations
Chang Liu, Hao Shen, Chuanying Li
Energy-dependent trapping of backscattered helium during magnetron sputtering growth: A molecular dynamics study
Pascal Brault, Anne-Lise Thomann, Alejandro Borroto
Alter-excitons in Altermagnets: Symmetry, Splitting and Dispersion
Yuanfan Xiong, Liangyu Wang, Xuan Wu et al.
All-electron RT-TDDFT with Exact Exchange based on Numeric Atom-centered Orbitals for Condensed Matter
Jianhang Xu, Christopher Shepard, Yosuke Kanai
Polyconvex neural-network surrogates with learned paired directional features for anisotropic hyperelastic homogenization
S. Ares de Parga, A. Cornejo, J. A. Hernández et al.
Parallel Design of a GPU-Resident Semi-Lagrangian Drift-Kinetic Solver on Unstructured Extruded Tokamak Meshes
Mark F. Adams