I recently presented (at this year's ICMPC conference) a paper on using online crowdsourcing (e.g. Amazon Mechanical Turk) for conducting music perception experiments. I've attached the paper for your information, which includes, in Section IV, examples of how the MIR community has been using this approach in recent years.
Online crowdsourcing as a research methodology definitely has pros and cons, but I feel that there is a growing potential for it, especially if the study requires mass participation and can be designed as a short/simple task.
On Sat, Nov 10, 2012 at 6:32 AM, Sam Mathias <smathias@xxxxxxxxxx> wrote:
During my PhD I created this online test using adobe flash: www.auditorytest.zxq.net
I used it to search for potential participants who were poor at pitch discrimination. [Mathias, Micheyl, & Bailey (2010) JASA, 127, 3026-3037]. I found flash to be highly versatile, have good functionality for auditory playback, and not too difficult to learn. However, I think support for this software is really dwindling these days (being replaced by HTML 5?) so it may be obsolete soon. It was also horrendously expense: I coded it with the 30-day trial version so I didn't have to pay for it.
On 9 November 2012 14:34, Robert Zatorre <robert.zatorre@xxxxxxxxx> wrote:
> Dear list
> Several times the list has received requests for participation in web-based experiments. We would like to implement something along these lines, and I am wondering if any of you who have experience with it have recommendations (for or against) software to use. We are looking for something reasonably inexpensive and simple to program that would allow us to present audio stimuli and collect behavioral responses, ideally with response times although that may not be so simple I realize.
> Any advice would be welcome. Thank you in advance
> Robert Zatorre
> Robert J. Zatorre, Ph.D.
> Montreal Neurological Institute
> 3801 University St.
> Montreal, QC Canada H3A 2B4
> phone: 1-514-398-8903
> fax: 1-514-398-1338
> e-mail: robert.zatorre@xxxxxxxxx
> web site: www.zlab.mcgill.ca
Dr. Samuel R. Mathias
Neural Mechanisms of Human Communication
Max Planck Institute for Human Cognitive and Brain Sciences
04103 Leipzig, Germany
Tel: +49 341 9940 2479