Modeling and analysis of dynamic decision making in sequential two-choice tasks

—The focus of the work in this paper is the construction and analysis of a dynamical system model for human decision making in sequential two-choice tasks. In these tasks, a human subject makes a series of interrelated decisions between two choices in order to maximize the reward, which depends on the past choices. Such experiments are common in behavioral and cognitive sciences and have been previously studied using prediction-error models and drift-diffusion models. Previous works have mainly examined average behaviors of humans over the entire task duration. In this work, we analyze asymptotic behaviors of human decision making in such tasks, using a nominal decision making policy based on behavioral aspects of humans. A hybrid system is used to model the closed loop of the decision making process in sequential two-choice tasks. Our work presents a control theory oriented perspective to explain observations in experiments carried out by cognitive scientists.

• Type: Conference
• Year: 2008
• Where: CDC
• Authors: Linh Vu, Kristi A. Morgansen
• Keywords: CDC 2008, Control Systems, Decision Making, Human Decision Making, Sequential Two-choice Tasks