Senior Thesis for Haverford College Convex Optimization, Newton's Method and Interior Point Method

Abstract

This paper consists of four general parts: convex sets; convex functions; convex optimization; and the interior-point algorithm. I will start by introducing the definition of convex sets and give three common convex set examples which will be used later in this paper, then prove the significant separating and supporting hyperplane theorems. Stepping into convex functions, in addition to offering definitions, I will also prove the first order and second-order conditions for convexity of a function, and then introduce a couple of examples that will be used in a convex optimization problem later. Next, I will provide the official definition of convex optimization problems and prove some characteristics they have, including the existence (through optimality criterion) and the uniqueness of a solution. I will also generate two convex optimization problems, one of which cannot be simply solved and requires additional skills. Afterward, I will introduce duality, for the sake of constructing the interior-point method. In the last section, I will first present the descent method and Newton's method, which serve as the foundation of the interior-point method. Then, I will show how to use the logarithmic barrier function and the central path to build up the interior-point method.