This paper proposes the Metadata Production Framework (MPF) as a common platform for generating content-based metadata. A lot of research on extracting useful information from audiovisual content has been conducted. Recently it has been necessary to integrate these research studies to get much higher semantic metadata. The aim of MPF is to provide an environment where we can easily make these types of processes, including multimodal integration. We have also released a Metadata Editor where a user can generate content-based metadata both manually and by using automatic metadata extraction modules based on MPF. Categories and Subject Descriptors H.4.0 [Information Systems Applications]: General General Terms Management, Design, Standardization. Keywords Metadata production, framework, MPEG-7, metadata editor, semantic metadata, multimodal integration, plug-in module.