Integrated Learning and Robust Optimization
Cheng Tan, Yuchen Mao, Shuming Wang, Huan Xu
Abstract
Many operational decisions require solving a linear program whose cost vector is unknown at decision time and must be predicted from contextual information. Because prediction and decision are only weakly aligned, the emerging integrated learning and optimization (ILO) paradigm trains the predictor through the downstream problem, judging a prediction by the decision it induces. However, predictions are inevitably imprecise, so robustness often enters the decision stage. To address this issue, we propose an integrated learning and robust optimization (ILRO) framework, where a robust decision problem is used both to define the training problem (termed the RSPO loss problem), and to produce the deployed decision. Thus, this framework simultaneously achieves both robustness and learning-decision alignment. To tackle its computational challenges, we develop a convex surrogate, RSPO+, and characterize when it is Fisher consistent. Moreover, the RSPO loss possesses informative gradients, allowing us to develop first-order computational methods. We also derive finite-sample excess risk bounds for both RSPO and RSPO+ predictors. Numerical experiments on transportation and portfolio problems, in comparison with multiple benchmarks, show the advantage in decision quality of the proposed framework. The gain is more pronounced for scenarios with limited samples, high-dimensional decisions, and model misspecification.
Create a lesson
Related papers
Level-Set Geometry and the Theoretical Performance of PDHG for Conic Linear Optimization
Zikai Xiong, Robert M. Freund
Trajectory Manifolds for Nonlinear Data-Enabled Predictive Control
Arda Bayer
Optimizing Lyapunov Certificates via Stability-Preserving Quadratization for Polynomial Systems
Yubo Cai, Gioele Zardini
Regularity of a Multidimensional Principal-Agent Problem with Separable Effort Costs
Shuaijie Qian, Guan Qiao
Near-Optimal Exact-Value Zeroth-Order Complexity for Smooth Strongly Convex Optimization
Wendao Wu, Haihan Zhang, Chenheng Zhang et al.
A VU-calculus for composite functions and the U-Hessian of partly smooth functions
Shuai Liu