Re: [AUDITORY] apps for web-based listening tests

Dear Jan,

Maybe the Web Audio Evaluation Tool would be a good choice for you? Pasting from their documentation, I see that it supports the following kinds of designs (alongside others, I daresay):

AB Test / Pairwise comparison [4, 5]: Two stimuli presented simultaneously, participant selects a preferred stimulus. (AB)
ABC/HR (ITU-R BS. 1116) (Mean Opinion Score: MOS) [6]: each stimulus has a continuous scale (5-1), labeled as Imperceptible, Perceptible but not annoying, Slightly annoying, Annoying, Very annoying.
-50 to 50 Bipolar with reference: each stimulus has a continuous scale -50 to 50 with default values as 0 in middle and a reference.
Absolute Category Rating (ACR) Scale [7]: Likert but labels are Bad, Poor, Fair, Good, Excellent
ABX Test [8]: Two stimuli are presented along with a reference and the participant has to select a preferred stimulus, often the closest to the reference. (ABX)
APE [1]: Multiple stimuli on one or more axes for inter-sample rating. (APE)
Comparison Category Rating (CCR) Scale [7]: ACR & DCR but 7 point scale, with reference: Much better, Better, Slightly better, About the same, Slightly worse, Worse, Much worse.
Degredation Category Rating (DCR) Scale [7]: ABC & Likert but labels are (5) Inaudible, (4) Audible but not annoying, (3) Slightly annoying, (2) Annoying, (1) Very annoying.
ITU-R 5 Point Continuous Impairment Scale [9]: Same as ABC/HR but with a reference.
Likert scale [10]: each stimulus has a five point scale with values: Strongly agree, Agree, Neutral, Disagree and Strongly disagree.
MUSHRA (ITU-R BS. 1534) [3]: Multiple stimuli are presented and rated on a continuous scale, which includes a reference, hidden reference and hidden anchors. (MUSHRA)
Pairwise Comparison (Better/Worse) [5]: every stimulus is rated as being either better or worse than the reference.
Rank Scale [12]: stimuli ranked on single horizontal scale, where they are ordered in preference order.
9 Point Hedonic Category Rating Scale [13]: each stimulus has a seven point scale with values: Like extremely, Like very much, Like moderate, Like slightly, Neither like nor dislike, Dislike extremely, Dislike very much, Dislike moderate, Dislike slightly. There is also a provided reference.

I haven't used it myself, but I've heard good things about it.

Best wishes,

Peter

On Wed, Jan 13, 2021 at 5:25 AM Jan Felcyn <janaku@xxxxxxxxxx> wrote:

Dear List!

I am looking for some web-based apps which allow to create listening tests. By creating listening tests I mean rather simple approach – like e.g. tests from Music Lab. Just playin’ stereo audio files, gathering responses and aggregate them in one file. One important feature is that it should be possible to create psychoacoustic tests like pair comparisons, 2AFS and so on.

Do you know any web-based platform for such thing? I’ve heard about BRAMS but never used it. I know Python and I know that I can use Django, but maybe there is something already prepared for such tests?

Thanks in advance for all comments!

Regards

---

Jan Felcyn PhD

Chair of Acoustics,

Adam Mickiewicz University,

Poznań, Poland