Multimedia signal processing for behavioral quantification in neuroscience

While there have been great advances in quantification of the genotype of organisms, including full genomes for many species, the quantification of phenotype is at a comparatively primitive stage. Part of the reason is technical difficulty: the phenotype covers a wide range of characteristics, ranging from static morphological features, to dynamic behavior. The latter poses challenges that are in the area of multimedia signal processing. Automated analysis of video and audio recordings of animal and human behavior is a growing area of research, ranging from the behavioral phenotyping of genetically modified mice or drosophila to the study of song learning in birds and speech acquisition in human infants. This paper reviews recent advances and identifies key problems for a range of behavior experiments that use audio and video recording. This research area offers both research challenges and an application domain for advanced multimedia signal processing. There are a number of MMSP too...

• Type: Conference
• Year: 2006
• Where: MM
• Authors: Peter Andrews, Haibin Wang, Dan Valente, Jihène Serkhane, Partha P. Mitra, Sigal Saar, Ofer Tchernichovski, Ilan Golani
• Keywords: MM 2006, Multimedia Signal Processing, Research Challenge, Static Morphological Features