Subject: Re: [AUDITORY] apps for web-based listening tests From: Jan Felcyn <janaku@xxxxxxxx> Date: Thu, 14 Jan 2021 09:42:42 +0100To jest wieloczj ciowa wiadomo f w formacie MIME. ------=_NextPart_000_004C_01D6EA59.9A9D0920 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Dear List! Thank you all for your comments and interesting findings! Definitely we = can choose something from your mails. Hopefully, we will run some = experiments using these tools in the near future. Regards Jan From: Chris Stecker=20 Sent: Wednesday, January 13, 2021 7:57 PM To: AUDITORY@xxxxxxxx=20 Subject: Re: apps for web-based listening tests Hi Jan and List, =20 I=E2=80=99d like to point you to a resource that you might find helpful = in developed you web-based or other remote testing approach: The = =E2=80=9CRemote Testing Wiki=E2=80=9D at = https://spatialhearing.org/remotetesting.=20 The Wiki is the result of activities by the Remote Testing Task Force, = which was launched last year by the Acoustical Society of America = Technical Committee on Psychological and Physiological Acoustics. It = includes information about issues and practices for remote testing, a = database of platforms that can be used to develop and deploy remote = testing research, and a variety of other resources including brief = reports of project experiences, bibliography of related works, and links = to other online resources.=20 The Platform Survey Database includes information that Jan could use to = find and select platforms, including several Python-based approaches, = that Task Force members and others have evaluated.=20 Finally, the Wiki has a lot of information in it currently but is still = growing. We still need help identifying and evaluating platforms the we = might not know about yet. There are links for submitting new examples = and platformsSo if you have experience with a platform (for example, = Borys seems familiar with SenseLabOnline), it would be GREAT if you = could visit the wiki and submit information about it. That goes for new = platforms and for updating information about features of existing = platforms. There is a simple survey tool that just takes a few minutes.=20 Feel free to reach out to me (or better yet, via the contact links on = the Wiki) if you have additional question.=20 Chris=20 =E2=80=94 G. Christopher Stecker, PhD, FASA Coordinating Editor, Psychological and Physiological Acoustics Journal of the Acoustical Society of America Chair, Task Force on Remote Testing ASA Technical Committee on Psychological and Physiological Acoustics cstecker@xxxxxxxx On Jan 12, 2021, at 11:46 PM, Borys Kowalewski <borys.k@xxxxxxxx> = wrote: Hello Jan, Good to hear from you! For paired comparisons, ABX etc. you might find SenseLabOnline = interesting. It allows you to create a multidimensional design and = prepare a simple graphical summary. You can also download the raw data = in a JSON file for further analysis. However, it is very much a quality- = and preference-evaluation tool, and except for the ABX it does not = support the typical =E2=80=9Cperformance-based=E2=80=9D n-AFC tests with = wrong and correct answers. Adaptive procedures are not an option either, = since all the tests require pre-loading of wave files. Hopefully other list members can suggest viable alternatives :) All best, Borys On Wed, Jan 13, 2021 at 06:23 Jan Felcyn <janaku@xxxxxxxx> wrote: Dear List! I am looking for some web-based apps which allow to create listening = tests. By creating listening tests I mean rather simple approach = =E2=80=93 like e.g. tests from Music Lab. Just playin=E2=80=99 stereo = audio files, gathering responses and aggregate them in one file. One = important feature is that it should be possible to create psychoacoustic = tests like pair comparisons, 2AFS and so on. Do you know any web-based platform for such thing? I=E2=80=99ve = heard about BRAMS but never used it. I know Python and I know that I can = use Django, but maybe there is something already prepared for such = tests? Thanks in advance for all comments! Regards --- Jan Felcyn PhD Chair of Acoustics, Adam Mickiewicz University, Pozna=C5=84, Poland ------=_NextPart_000_004C_01D6EA59.9A9D0920 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <HTML><HEAD> <META content=3D"text/html; charset=3Dutf-8" = http-equiv=3DContent-Type></HEAD> <BODY style=3D"WORD-WRAP: break-word; -webkit-nbsp-mode: space" = dir=3Dltr> <DIV dir=3Dltr> <DIV style=3D"FONT-SIZE: 12pt; FONT-FAMILY: 'Calibri'; COLOR: #000000"> <DIV>Dear List!</DIV> <DIV>Thank you all for your comments and interesting findings! = Definitely we can=20 choose something from your mails. Hopefully, we will run some = experiments using=20 these tools in the near future.</DIV> <DIV>Regards</DIV> <DIV>Jan</DIV> <DIV=20 style=3D'FONT-SIZE: small; TEXT-DECORATION: none; FONT-FAMILY: = "Calibri"; FONT-WEIGHT: normal; COLOR: #000000; FONT-STYLE: normal; = DISPLAY: inline'> <DIV style=3D"FONT: 10pt tahoma"> <DIV> </DIV> <DIV style=3D"BACKGROUND: #f5f5f5"> <DIV style=3D"font-color: black"><B>From:</B> <A=20 title=3Dcstecker@xxxxxxxx>Chris Stecker</A> </DIV> <DIV><B>Sent:</B> Wednesday, January 13, 2021 7:57 PM</DIV> <DIV><B>To:</B> <A = title=3DAUDITORY@xxxxxxxx>AUDITORY@xxxxxxxx</A>=20 </DIV> <DIV><B>Subject:</B> Re: apps for web-based listening = tests</DIV></DIV></DIV> <DIV> </DIV></DIV> <DIV=20 style=3D'FONT-SIZE: small; TEXT-DECORATION: none; FONT-FAMILY: = "Calibri"; FONT-WEIGHT: normal; COLOR: #000000; FONT-STYLE: normal; = DISPLAY: inline'>Hi=20 Jan and List, =20 <DIV> </DIV> <DIV>I=E2=80=99d like to point you to a resource that you might find = helpful in=20 developed you web-based or other remote testing approach: The = =E2=80=9CRemote Testing=20 Wiki=E2=80=9D at <A=20 href=3D"https://spatialhearing.org/remotetesting">https://spatialhearing.= org/remotetesting</A>.=20 </DIV> <DIV> </DIV> <DIV>The Wiki is the result of activities by the Remote Testing Task = Force,=20 which was launched last year by the Acoustical Society of America = Technical=20 Committee on Psychological and Physiological Acoustics. It includes = information=20 about issues and practices for remote testing, a database of platforms = that can=20 be used to develop and deploy remote testing research, and a variety of = other=20 resources including brief reports of project experiences, bibliography = of=20 related works, and links to other online resources. </DIV> <DIV> </DIV> <DIV>The Platform Survey Database includes information that Jan could = use to=20 find and select platforms, including several Python-based approaches, = that Task=20 Force members and others have evaluated. </DIV> <DIV> </DIV> <DIV>Finally, the Wiki has a lot of information in it currently but is = still=20 growing. We still need help identifying and evaluating platforms the we = might=20 not know about yet. There are links for submitting new examples and = platformsSo=20 if you have experience with a platform (for example, Borys seems = familiar with=20 SenseLabOnline), it would be GREAT if you could visit the wiki and = submit=20 information about it. That goes for new platforms and for updating = information=20 about features of existing platforms. There is a simple survey tool that = just=20 takes a few minutes. </DIV> <DIV> </DIV> <DIV>Feel free to reach out to me (or better yet, via the contact links = on the=20 Wiki) if you have additional question. </DIV> <DIV> </DIV> <DIV>Chris </DIV> <DIV> </DIV> <DIV> <DIV> </DIV> <DIV> <DIV>=E2=80=94<BR><BR>G. Christopher Stecker, PhD, = FASA<BR><BR>Coordinating Editor,=20 Psychological and Physiological Acoustics<BR>Journal of the Acoustical = Society=20 of America<BR><BR>Chair, Task Force on Remote Testing<BR>ASA Technical = Committee=20 on Psychological and Physiological=20 Acoustics<BR><BR><A>cstecker@xxxxxxxx</A><BR><BR><BR></DIV></DI= V> <DIV><BR> <BLOCKQUOTE type=3D"cite"> <DIV>On Jan 12, 2021, at 11:46 PM, Borys Kowalewski=20 <<A>borys.k@xxxxxxxx</A>> wrote:</DIV> <DIV> </DIV> <DIV> <DIV>Hello Jan,</DIV> <DIV> </DIV> <DIV>Good to hear from you!</DIV> <DIV> </DIV> <DIV>For paired comparisons, ABX etc. you might find SenseLabOnline=20 interesting. It allows you to create a multidimensional design and = prepare a=20 simple graphical summary. You can also download the raw data in a JSON = file=20 for further analysis. However, it is very much a quality- and=20 preference-evaluation tool, and except for the ABX it does not support = the=20 typical =E2=80=9Cperformance-based=E2=80=9D n-AFC tests with wrong and = correct answers.=20 Adaptive procedures are not an option either, since all the tests = require=20 pre-loading of wave files.</DIV> <DIV> </DIV> <DIV>Hopefully other list members can suggest viable alternatives = :)</DIV> <DIV> </DIV> <DIV>All best,</DIV> <DIV>Borys</DIV> <DIV> <DIV> </DIV> <DIV class=3Dgmail_quote> <DIV class=3Dgmail_attr dir=3Dltr>On Wed, Jan 13, 2021 at 06:23 Jan = Felcyn=20 <<A>janaku@xxxxxxxx</A>> wrote:<BR></DIV> <BLOCKQUOTE class=3Dgmail_quote=20 style=3D"PADDING-LEFT: 1ex; BORDER-LEFT: rgb(204,204,204) 1px solid; = MARGIN: 0px 0px 0px 0.8ex"> <DIV dir=3Dltr> <DIV dir=3Dltr> <DIV style=3D"FONT-SIZE: 12pt; FONT-FAMILY: calibri"> <DIV style=3D"FONT-FAMILY: calibri">Dear List!</DIV> <DIV style=3D"FONT-FAMILY: calibri"> </DIV> <DIV style=3D"FONT-FAMILY: calibri">I am looking for some web-based = apps which=20 allow to create listening tests. By creating listening tests I mean = rather=20 simple approach =E2=80=93 like e.g. tests from Music Lab. Just = playin=E2=80=99 stereo audio=20 files, gathering responses and aggregate them in one file. One = important=20 feature is that it should be possible to create psychoacoustic tests = like=20 pair comparisons, 2AFS and so on.</DIV> <DIV style=3D"FONT-FAMILY: calibri"> </DIV> <DIV style=3D"FONT-FAMILY: calibri">Do you know any web-based = platform for=20 such thing? I=E2=80=99ve heard about BRAMS but never used it. I know = Python and I=20 know that I can use Django, but maybe there is something already = prepared=20 for such tests?</DIV> <DIV style=3D"FONT-FAMILY: calibri"> </DIV> <DIV style=3D"FONT-FAMILY: calibri">Thanks in advance for all = comments!</DIV> <DIV style=3D"FONT-FAMILY: calibri"> </DIV> <DIV style=3D"FONT-FAMILY: calibri">Regards</DIV> <DIV style=3D"FONT-FAMILY: calibri"> </DIV> <DIV style=3D"FONT-FAMILY: calibri">---</DIV> <DIV style=3D"FONT-FAMILY: calibri">Jan Felcyn PhD</DIV> <DIV style=3D"FONT-FAMILY: calibri">Chair of Acoustics,</DIV> <DIV style=3D"FONT-FAMILY: calibri">Adam Mickiewicz = University,</DIV> <DIV style=3D"FONT-FAMILY: calibri">Pozna=C5=84,=20 = Poland</DIV></DIV></DIV></DIV></BLOCKQUOTE></DIV></DIV></DIV></BLOCKQUOTE= ></DIV> <DIV> </DIV></DIV></DIV></DIV></DIV></BODY></HTML> ------=_NextPart_000_004C_01D6EA59.9A9D0920--