MIMiC: Multimodal Interactive Motion Controller

Abstract—We introduce a new algorithm for real-time interactive motion control and demonstrate its application to motion captured data, pre-recorded videos and HCI. Firstly, a data set of frames are projected into a lower dimensional space. An appearance model is learnt using a multivariate probability distribution. A novel approach to determining transition points is presented based on k-medoids, whereby appropriate points of intersection in the motion trajectory are derived as cluster centres. These points are used to segment the data into smaller subsequences. A transition matrix combined with a kernel density estimation is used to determine suitable transitions between the subsequences to develop novel motion. To facilitate real-time interactive control, conditional probabilities are used to derive motion given user commands. The user commands can come from any modality including auditory, touch and gesture. The system is also extended to HCI using audio signals of speech in a co...

• Type: Journal
• Year: 2011
• Where: TMM
• Authors: Dumebi Okwechime, Eng-Jon Ong, Richard Bowden
• Keywords: Lower Dimensional Space, Real-time, Real-time Interactive Motion, TMM 2011