Dynamic programming in a heuristically confined state space: a stochastic resource-constrained project scheduling application

The Resource-Constrained Project Scheduling Problem(RCPSP) is a significant challenge in highly regulated industries, such as pharmaceuticals and agrochemicals, where a large number of candidate new products must undergo a set of tests for certification. We propose a novel way of addressing the uncertainties in the RCPSP including the uncertainties in task durations and costs, as well as uncertainties in the results of tasks(success or failure) by using a discrete time Markov chain, which enables us to model probabilistic correlation of the uncertain parameters. The resulting stochastic optimization problem can be solved by using dynamic programming, but the computational load renders this impractical. Instead, we develop a new way to combine heuristic solutions through dynamic programming in the state space that the heuristics generate. The proposed approach is tested on a fairly complicated stochastic RCPSP, which has 1,214,693,756 parameter realizations(scenarios), with 5 projects ...

• Type: Journal
• Year: 2004
• Where: CCE
• Authors: Jaein Choi, Matthew J. Realff, Jay H. Lee
• Keywords: CCE 2004, CCE 2007, Dynamic Programming, Project Scheduling Problem, Stochastic Optimization Problem