Non-traditional environments often change rapidly without forewarning, are difficult or impossible to control, and have other environmental and operational constraints that cannot easily be modeled in a laboratory, partly because the necessary level of ecological validity is almost impossible to achieve in the artificial lab environment. Current in situ field study evaluation techniques are insufficient in these environments. Furthermore, it is often difficult or impossible to ascertain which behavioral data are needed to answer questions about user requirements, UI design, and user acceptance. In this workshop, we will use case studies to create and explore frameworks for future non-traditional field study evaluations. Keywords Non-Traditional Environments, Ecological Validity, Evaluation Techniques, Ubiquitous Computing, Usability Testing, Performance ACM Classification Keywords H.5.2 [User Interfaces]: Evaluation/Methodology