Q-DPM: An Efficient Model-Free Dynamic Power Management Technique

When applying Dynamic Power Management (DPM) technique to pervasively deployed embedded systems, the technique needs to be very efficient so that it is feasible to implement the technique on low end processor and tightbudget memory. Furthermore, it should have the capability to track time varying behavior rapidly because the time varying is an inherent characteristic of real world system. Existing methods, which are usually model-based, may not satisfy the aforementioned requirements. In this paper, we propose a model-free DPM technique based on Q-Learning. Q-DPM is much more efficient because it removes the overhead of parameter estimator and modeswitch controller. Furthermore, its policy optimization is performed via consecutive online trialing, which also leads to very rapid response to time varying behavior.

• Type: Conference
• Year: 2005
• Where: DATE
• Authors: Min Li, Xiaobo Wu, Richard Yao, Xiaolang Yan
• Keywords: DATE 2005, Dynamic Power Management, Hardware, Model-free Dpm Technique, Time Varying Behavior