Subject: Re: benchmark systems for MIR From: alexander lerch <lerch@xxxxxxxx> Date: Fri, 17 Oct 2008 12:14:56 +0200 List-Archive:<http://lists.mcgill.ca/scripts/wa.exe?LIST=AUDITORY>Hi Arijit, probably the closest answer to your questions would be the MIREX effort: http://www.music-ir.org/mirex/2008/index.php/Main_Page I don't think that fingerprinting systems have been evaluated during the last years, but you are open to propose such an evaluation task for next year. Best, Alexander #ARIJIT BISWAS# wrote: > Hello all! > > A novice question ;-) > > After designing ones music information retrieval system how do one > measure the performance of ones system? > Do you compare the performance with some existing benchmark systems? If > yes, how could I get access to those benchmark systems? > > For example, if Ive designed an audio fingerprinting system, with whom > should I compare? Similarly, with whom should I compare my genre > classification or mood extraction algorithm? > > It would be really great if I could get such a list ;-) > > Best Regards, > ~Arijit > -- :www.zplane.de katzbachstr.21 d-10965 berlin fon: +49.30.854 09 15.0 fax: +49.30.854 09 15.5