Toward the Scientific Evaluation of Music Information Retrieval Systems

Show simple item record J. Stephen Downie en_US
dc.contributor.editor Holger H. Hoos en_US
dc.contributor.editor David Bainbridge en_US 2004-10-21T04:26:21Z 2004-10-21T04:26:21Z 2003-10-26 en_US
dc.identifier.isbn 0-9746194-0-X en_US
dc.description.abstract This paper outlines the findings-to-date of a project to assist in the efforts being made to establish a TREC-like evaluation paradigm within the Music Information Retrieval (MIR) research community. The findings and recommendations are based upon expert opinion garnered from members of the Information Retrieval (IR), Music Digital Library (MDL) and MIR communities with regard to the construction and implementation of scientifically valid evaluation frameworks. Proposed recommendations include the creation of data-rich query records that are both grounded in real-world requirements and neutral with respect to retrieval technique(s) being examined; adoption, and subsequent validation, of a “reasonable person” approach to “relevance” assessment; and, the development of a secure, yet accessible, research environment that allows researchers to remotely access the large-scale testbed collection. en_US
dc.description.provenance Made available in DSpace on 2004-10-21T04:26:21Z (GMT). No. of bitstreams: 1 paper.pdf: 221795 bytes, checksum: 66f3849dc76dc830c28af831771c50aa (MD5) Previous issue date: 2003-10-26 en
dc.format.extent 221795 bytes
dc.format.mimetype application/pdf
dc.language en en_US
dc.language.iso en_US
dc.publisher Johns Hopkins University en_US
dc.subject IR Systems and Algorithms en_US
dc.subject Digital Libraries en_US
dc.title Toward the Scientific Evaluation of Music Information Retrieval Systems en_US
dc.type article en_US

Files in this item

Files Size Format Download
paper.pdf 221.7Kb application/pdf Download

This item appears in the following Collection(s)

Show simple item record