Sciweavers

FOGA
2013

Objective improvement in information-geometric optimization

10 years 6 months ago
Objective improvement in information-geometric optimization
Information-Geometric Optimization (IGO) is a unified framework of stochastic algorithms for optimization problems. Given a family of probability distributions, IGO turns the original optimization problem into a new maximization problem on the parameter space of the probability distributions. IGO updates the parameter of the probability distribution along the natural gradient, taken with respect to the Fisher metric on the parameter manifold, aiming at maximizing an adaptive transform of the objective function. IGO recovers several known algorithms as particular instances: for the family of Bernoulli distributions IGO recovers PBIL, for the family of Gaussian distributions the pure rank-µ CMAES update is recovered, and for exponential families in expectation parametrization the cross-entropy/ML method is recovered. This article provides a theoretical justification for the IGO framework, by proving that any step size not greater than 1 guarantees monotone improvement over the course...
Youhei Akimoto, Yann Ollivier
Added 28 Apr 2014
Updated 28 Apr 2014
Type Journal
Year 2013
Where FOGA
Authors Youhei Akimoto, Yann Ollivier
Comments (0)