In this paper we present the results of a study designed to evaluate the computer-based methods of learning American Sign Language (ASL). We describe a method including an initial instruction session along with receptive and generative language tests which were administered after a week-long retention interval. We show a strong correlations (=.62, =.57) between the initial session's instruction and the receptive and generative levels of vocabulary signing. Based on the results of our experiment, we establish a baseline for further exploration of ASL vocabulary acquisition and identify further paths for language based instruction. Categories and Subject Descriptors K.3.1 [Computing Milieux]: Computers and Education-Computer-assisted instruction General Terms Languages, Human factors, Experimentation Keywords Sign Language, computer assisted language learning