Formal models and algorithms for decentralized decision making under uncertainty