The 2008 Signal Separation Evaluation Campaign: A Community-Based Approach to Large-Scale Evaluation

Abstract. This paper introduces the first community-based Signal Separation Evaluation Campaign (SiSEC 2008), coordinated by the authors. This initiative aims to evaluate source separation systems following specifications agreed between the entrants. Four speech and music datasets were contributed, including synthetic mixtures as well as microphone recordings and professional mixtures. The source separation problem was split into four tasks, each evaluated via different objective performance criteria. We provide an overview of these datasets, tasks and criteria, summarize the results achieved by the submitted systems and discuss organization strategies for future campaigns.

• Type: Conference
• Year: 2009
• Where: IDA
• Authors: Emmanuel Vincent, Shoko Araki, Pau Bofill
• Keywords: Artificial Intelligence, Community-based Signal Separation, IDA 2009, Source Separation, Source Separation Systems