Improving quality of prediction in highly dynamic environments using approximate dynamic programming

In many applications, decision making under uncertainty often involves two steps- prediction of a certain quality parameter or indicator of the system under study and the subsequent use of the prediction in choosing actions. The prediction process is severely challenged by highly dynamic environments that particularly involve sequential decision making, such as air traffic control at airports in which congestion prediction is critical for smooth departure operations. Taxi-out time of a flight is an excellent indicator of surface congestion and is a quality parameter used in the assessment of airport delays. The regression, queueing, and moving average models have been shown to perform poorly in predicting taxi-out times because they are slow in adapting to the changing airport dynamics. This paper presents an approximate dynamic programming approach (reinforcement learning, RL) to taxi-out time prediction. The taxi-out prediction performance was tested on flight data obtained from t...

• Type: Journal
• Year: 2010
• Where: QRE
• Authors: Rajesh Ganesan, Poornima Balakrishna, Lance Sherry
• Keywords: Average Model, Prediction, QRE 2010, Quality Parameter