Sciweavers

ISAAC
2010
Springer

Lower Bounds for Howard's Algorithm for Finding Minimum Mean-Cost Cycles

13 years 9 months ago
Lower Bounds for Howard's Algorithm for Finding Minimum Mean-Cost Cycles
Howard's policy iteration algorithm is one of the most widely used algorithms for finding optimal policies for controlling Markov Decision Processes (MDPs). When applied to weighted directed graphs, which may be viewed as Deterministic MDPs (DMDPs), Howard's algorithm can be used to find Minimum Mean-Cost cycles (MMCC). Experimental studies suggest that Howard's algorithm works extremely well in this context. The theoretical complexity of Howard's algorithm for finding MMCCs is a mystery. No polynomial time bound is known on its running time. Prior to this work, there were only linear lower bounds on the number of iterations performed by Howard's algorithm. We provide the first weighted graphs on which Howard's algorithm performs (n2 ) iterations, where n is the number of vertices in the graph.
Thomas Dueholm Hansen, Uri Zwick
Added 13 Feb 2011
Updated 13 Feb 2011
Type Journal
Year 2010
Where ISAAC
Authors Thomas Dueholm Hansen, Uri Zwick
Comments (0)