Tilted Convexity and an Exact Offline-Online Separation
Mohammad Pedramfar, Rajiv Khanna, Christopher John Quinn, Vaneet Aggarwal
Abstract
Convexity has three equivalent descriptions: support by affine functions, monotonicity of the subdifferential, and increasing secant slopes. We weaken all three by one distortion with parameter γ∈(0,1], which multiplies positive changes by γ and divides negative ones by γ. The resulting classes are the convex functions at γ=1 and, for γ<1, are distinct and nested, with the parameter dropping by at most a square along the chain. For proper lower semicontinuous functions in these classes, the effective domain is convex, local minimizers are global, and the function is locally Lipschitz on the relative interior of its domain. The classes separate offline from online optimization over compact convex sets with efficient projection, with access to function values and bounded support vectors. A smooth member of any class can be minimized to additive accuracy with poly(1/) first-order queries and projections. Online, with nonpositive losses and α-regret measured against α times the best fixed point, a polynomial-time algorithm achieves γ-regret O( T) on the largest class. For every fixed, effectively specified γ∈(0,1) and every α∈(γ,1], no randomized polynomial-time algorithm has sublinear expected α-regret unless NP=RP, already for smooth concave polynomial losses in the smallest class, each minimized by one linear optimization. Thus, unless NP=RP, γ is the exact online coefficient of each class, while the offline coefficient is one.
Create a lesson
Related papers
Coarse Semantic Blocks for Efficient Training-Free Sparse Attention
Sosuke Kobayashi, Shoichiro Yamaguchi, Seiya Tokui
What Is the Influence of Task Order in Continual Learning? An Empirical Study and Order-Aware Evaluation for Motion Forecasting
Zirui Li, Yunlong Lin, Haohan Yang et al.
Reciprocity Can Erase Direction:tructural Boundaries and Controlled Utility of Magnetic Graph Networks
Dawei Han, Zicheng Wang, Yaoxing Ren et al.
Deep Learning Compilers: Architecture, Optimization, and Empirical Characterization
Jinghao Wen, Ruixuan Wang, Xun Jiao
OmniST: Topology-Invariant Spatiotemporal Forecasting with Guaranteed-Coverage Uncertainty at Unseen Sensor Locations
Praveg Vashishtha
LIRA: A More Interpretable Dynamic Loss-Informed Rank Allocation for Low-Rank Adaptation
Sihao Wang, Bozheng Li, Xuemiao Xu et al.