We studied the effects of varying the fidelity and automation levels of a Ubicomp application prototype. Our results show that the interactive prototype captured the same usability issues that the paper prototype studies did and more. We found that paper prototyping is insufficient for supporting unique Ubicomp requirements, such as scalability, but a prototype with higher fidelity and automation levels can enhance the quality of interaction data available for evaluation. Keywords Ubiquitous Computing, Lo-fi Prototyping, Wizard of Oz.