The Importance of Cross Database Evaluation in Sound Classification

Embargo until
Date
2003-10-26
Journal Title
Journal ISSN
Volume Title
Publisher
Johns Hopkins University
Abstract
In numerous articles (Martin and Kim, 1998; Fraser and Fujinaga, 1999; and many others) sound classification algorithms are evaluated using "self classification" - the learning and test groups are randomly selected out of the same sound database. We will show that "self classification" is not necessarily a good statistic for the ability of a classification algorithm to learn, generalize or classify well. We introduce the alternative "Minus-1 DB" evaluation method and demonstrate that it does not have the shortcomings of "self classification".
Description
Keywords
IR Systems and Algorithms, Music Analysis
Citation
Collections