Icons and digital images used in augmentative and alternative communication (AAC) are not as effective in illustrating verbs, especially for people with cognitive degeneration or impairment. Realistic videos have possible advantages for conveying verbs, as verified in our studies with young and old adults comparing single image, multiple images, animations, and video clips. Videos are especially more effective for verbs that show concrete movements or actions. Based on our studies, we propose rules for filming video verb representations, exploring possible visual cues and other factors that may affect people's perception and interpretation. Categories and Subject Descriptors H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems
Xiaojuan Ma, Perry R. Cook