This paper describes the development of Castaway, a context-aware task management system. Specifically, we describe a three-week field study with thirty-five participants, the results of which illuminate the nature of people's recorded tasks. We further describe in detail iterations made to our task management interface, including a map-based view, and the insights gained that will inform future design and development.