A Model-driven Method and a Tool for Developing Gesture-based Information System Interfaces

Abstract. Considering the technological advances in touch-based devices, gesture-based interaction has become a prevalent feature in many application domains. Information systems are starting to explore this type of interaction. Currently, gesture specifications are hard-coded by developers at the source code level, hindering its reusability and portability. Similarly, defining new gestures in line with users’ requirements is further complicated. This paper describes a model-driven approach to include gesture-based interaction in desktop information systems and a tool prototype to: capture user-sketched multi-stroke gestures and transform them into a model, automatically generating the gesture catalogue for gesture-based interaction technologies and gesture-based interface source code. We demonstrate our approach in several applications, ranging from case tools to form-based information systems.

• Type: Journal
• Year: 2015
• Where: CAISE
• Authors: Otto Parra, Sergio España, Oscar Pastor
• Keywords: CAISE 2015, Information Technology