Most work investigating mobile HCI is carried out within controlled laboratory settings; these spaces are not representative of the real-world environments for which the technology will predominantly be used. The result of which can produce a skewed or inaccurate understanding of interaction behaviors and users’ abilities. While mobile in-the-wild studies provide more realistic representations of technology usage, there are additional challenges to conducting data collection outside of the lab. In this paper we discuss these challenges and present TinyBlackBox, a standalone data collection framework to support mobile in-thewild studies with today’s smartphone and tablet devices. Categories and Subject Descriptors H.5.2 [User Interfaces] Evaluation/Methodology, User- Centered Design; D.2.2 [Design Tools and Techniques]: Miscellaneous Keywords Mobile Computing, In-the-wild, User-Centered Design, Data Collection, Toolkit