Online Convex Programming and Generalized Infinitesimal Gradient Ascent

Convex programming involves a convex set F Rn and a convex cost function c : F R. The goal of convex programming is to find a point in F which minimizes c. In online convex programming, the convex set is known in advance, but in each step of some repeated optimization problem, one must select a point in F before seeing the cost function for that step. This can be used to model factory production, farm production, and many other industrial optimization problems where one is unaware of the value of the items produced until they have already been constructed. We introduce an algorithm for this domain. We also apply this algorithm to repeated games, and show that it is really a generalization of infinitesimal gradient ascent, and the results here imply that generalized infinitesimal gradient ascent (GIGA) is universally consistent.

• Type: Conference
• Year: 2003
• Where: ICML
• Authors: Martin Zinkevich
• Keywords: Convex Cost Function, Convex Programming, ICML 2003, Infinitesimal Gradient Ascent, Machine Learning