Re: [AUDITORY] apps for web-based listening tests

Dear Jan, and everyone,

I'd like to introduce another listening test tool HULTI-GEN, which we developed at the University of Huddersfield.

This one is Max-based. I know you are looking for web-based one, but the latest version (v2) includes psychometric tests (nAFC, Yes-No, Staircase, ABX, etc.) as well as quality evaluation tests (ITU-R and ITU-T methods). And it provides headphone equalisation using an extensive set of headphone filters included or any custom-loaded headphone filter you might use. So it can be useful in remote testing where people use different headphones. It also offers very convenient test block design with repeats and randomisation, JSON config file saving, recall, result file saved in csv, etc. It also supports multichannel audio up to 64 channels, and can binauralise the audio for arbitrary speaker positions using a SOFA file. Hulti-gen is the only listening tool that provides such multichannel/binaural functionality as far as I know.

You can download it from here: https://doi.org/10.5281/zenodo.4108976

Although it's not online, the participants can easily install the software, load the config file you send them, and the test is ready to go. I've recently conducted a Yes/No test remotely using the tool, and it was very smooth.

If any questions, please let me know.

Best wishes,

Hyunkook

=========================================
Dr Hyunkook Lee, BMus(Tonmeister), PhD, FAES, FHEA

Reader (Associate Professor) in Music Technology

Director of the Centre for Audio and Psychoacoustic Engineering (CAPE)

Founder/Leader of the Applied Psychoacoustics Laboratory (APL)

http://www.hyunkooklee.com

http://www.hud.ac.uk/apl

Phone: +44 (0)1484 471893
Email: h.lee@xxxxxxxxx

Office: HA2/06

School of Computing and Engineering
University of Huddersfield
Huddersfield
HD1 3DH
United Kingdom

From: AUDITORY - Research in Auditory Perception <AUDITORY@xxxxxxxxxxxxxxx> on behalf of Jan Felcyn <janaku@xxxxxxxxxx>
Sent: 14 January 2021 08:42
To: AUDITORY@xxxxxxxxxxxxxxx <AUDITORY@xxxxxxxxxxxxxxx>
Subject: Re: [AUDITORY] apps for web-based listening tests

Dear List!

Thank you all for your comments and interesting findings! Definitely we can choose something from your mails. Hopefully, we will run some experiments using these tools in the near future.

Regards

Jan

From: Chris Stecker

Sent: Wednesday, January 13, 2021 7:57 PM

To: AUDITORY@xxxxxxxxxxxxxxx

Subject: Re: apps for web-based listening tests

Hi Jan and List,

I’d like to point you to a resource that you might find helpful in developed you web-based or other remote testing approach: The “Remote Testing Wiki” at https://spatialhearing.org/remotetesting.

The Wiki is the result of activities by the Remote Testing Task Force, which was launched last year by the Acoustical Society of America Technical Committee on Psychological and Physiological Acoustics. It includes information about issues and practices for remote testing, a database of platforms that can be used to develop and deploy remote testing research, and a variety of other resources including brief reports of project experiences, bibliography of related works, and links to other online resources.

The Platform Survey Database includes information that Jan could use to find and select platforms, including several Python-based approaches, that Task Force members and others have evaluated.

Finally, the Wiki has a lot of information in it currently but is still growing. We still need help identifying and evaluating platforms the we might not know about yet. There are links for submitting new examples and platformsSo if you have experience with a platform (for example, Borys seems familiar with SenseLabOnline), it would be GREAT if you could visit the wiki and submit information about it. That goes for new platforms and for updating information about features of existing platforms. There is a simple survey tool that just takes a few minutes.

Feel free to reach out to me (or better yet, via the contact links on the Wiki) if you have additional question.

Chris

—

G. Christopher Stecker, PhD, FASA

Coordinating Editor, Psychological and Physiological Acoustics
Journal of the Acoustical Society of America

Chair, Task Force on Remote Testing
ASA Technical Committee on Psychological and Physiological Acoustics

cstecker@xxxxxxxxxxxxxxxxxx

On Jan 12, 2021, at 11:46 PM, Borys Kowalewski <borys.k@xxxxxxxxx> wrote:

Hello Jan,

Good to hear from you!

For paired comparisons, ABX etc. you might find SenseLabOnline interesting. It allows you to create a multidimensional design and prepare a simple graphical summary. You can also download the raw data in a JSON file for further analysis. However, it is very much a quality- and preference-evaluation tool, and except for the ABX it does not support the typical “performance-based” n-AFC tests with wrong and correct answers. Adaptive procedures are not an option either, since all the tests require pre-loading of wave files.

Hopefully other list members can suggest viable alternatives :)

All best,

Borys

On Wed, Jan 13, 2021 at 06:23 Jan Felcyn <janaku@xxxxxxxxxx> wrote:

Dear List!

I am looking for some web-based apps which allow to create listening tests. By creating listening tests I mean rather simple approach – like e.g. tests from Music Lab. Just playin’ stereo audio files, gathering responses and aggregate them in one file. One important feature is that it should be possible to create psychoacoustic tests like pair comparisons, 2AFS and so on.

Do you know any web-based platform for such thing? I’ve heard about BRAMS but never used it. I know Python and I know that I can use Django, but maybe there is something already prepared for such tests?

Thanks in advance for all comments!

Regards

---

Jan Felcyn PhD

Chair of Acoustics,

Adam Mickiewicz University,

Poznań, Poland

University of Huddersfield inspiring global professionals.

This transmission is confidential and may be legally privileged. If you receive it in error, please notify us immediately by e-mail and remove it from your system. If the content of this e-mail does not relate to the business of the University of Huddersfield, then we do not endorse it and will accept no liability.