Re: [AUDITORY] Online rhythm production experiments: Update ("Jacoby, Nori" )


Subject: Re: [AUDITORY] Online rhythm production experiments: Update
From:    "Jacoby, Nori"  <nori.jacoby@xxxxxxxx>
Date:    Tue, 26 Jan 2021 16:27:41 +0000

--_000_3b7a72638f5048f188f853b70ff0a819aempgde_ Content-Type: text/plain; charset="windows-1250" Content-Transfer-Encoding: quoted-printable Dear auditory list, We would like to share this preprint to present and validate a recently dev= eloped technology in our group: REPP (Rhythm ExPeriment Platform). This tec= hnology is able to measure SMS in online experiments with high temporal fid= elity while also working efficiently using hardware and software available = to most participants online. We give details on the technology in the prep= rint as well as validate it in a series of calibration and behavioral exper= iments. We demonstrate that our technology achieves high temporal accuracy = (latency and jitter within 2 ms on average) and high test-retest reliabilit= y both in the laboratory and online. We plan to release this technology as= a free and open-source framework alongside the journal version of the pape= r. This technology is fully automated and customizable, enabling researchers t= o monitor online experiments in real time and to implement a wide variety o= f SMS paradigms. For example, using REPP we successfully replicated online = a transmission chain experiment to estimate perceptual priors for simple rh= ythms via iterated reproduction of random temporal sequences. In a recent p= aper, we also show that REPP can be used to collect a large tapping dataset= with more than 500 participants to study individual differences on SMS in = the general population (Niarchou et al., 2021). We therefore believe this t= echnology can support SMS experiments that would be nearly impossible in th= e lab while massively increasing the scalability and speed of data collecti= on. https://www.biorxiv.org/content/10.1101/2021.01.15.426897v2 Very best, Nori Jacoby, Manuel Anglada-Tort, Peter Harrison Nori Jacoby Max Planck Group Leader, =93Computational Auditory Perception=94 Max Planck Institute for Empirical Aesthetics Gr=FCneburgweg 14, 60322 Frankfurt am Main, Germany nori.jacoby@xxxxxxxx<mailto:nori.jacoby@xxxxxxxx> +49 69 8300479-820 ---------- Forwarded message --------- From: Prof. dr Henkjan Honing <honing@xxxxxxxx<mailto:honing@xxxxxxxx>> Date: Mon, Oct 26, 2020 at 5:24 AM Subject: [AUDITORY] Online rhythm production experiments: Update To: AUDITORY@xxxxxxxx<mailto:AUDITORY@xxxxxxxx> <AUDITORY@xxxxxxxx= ts.mcgill.ca<mailto:AUDITORY@xxxxxxxx>> Thanks for the suggestions. Below a brief summary of the responses I receiv= ed. These came in three flavors: 1) solutions suggesting specific hardware at the client side (e.g. using e.= g., a two channel audio card) 2) solutions using client side software (e.g., javascript) 3) offline and/or post-processing solutions For our purpose (relatively large-scale online rhythm production experiment= s) solution type 1 is unrealistic. [input from Werner Hemmert and others] Solution type 2 was tried by several researchers/institutes (using, e.g, Ps= ychoPY javascript, etc.). However, most report - as expected - relatively l= arge timing errors, largely due to keyboard scan rates, drivers, and/or ope= rating system (as reported in the references mentioned in the original mess= age). (Despite the claim of psychopy.org<http://psychopy.org> of <4ms preci= sion in online studies). [Input from Ignacio Spiousas, Nick Haywood, Ben Schultz, Kyle Jasmin and ot= hers] N.B. PeerJ recently published a comparative study [1] Solution type 3 was suggested by some: i.e. o record the rhythmic pattern b= y tapping e.g. with a pencil on your desk or device microphone, along with = the streamed sound, at the client side, upload the resulting audio file usi= ng a standard browser, and analyse it at the serverside using onset-detecti= on and some crosscorrelation techniques. Depending on the sampling rate, la= tencies can be reduced to 1 ms or less. [Input from Roger Dannenberg, Krzysztof Basi=F1ski, Justin London and other= s] N.B.1 Ben Schultz announced to make his version of Solution type 1 availabl= e as open source (repeated below). N.B.2. Nori Jacoby announced to make their version of Solution type 3 avail= able as appendix to a forthcoming paper (repreated below). Nevertheless, my hope is still on some elegant solution of type 2. If you h= ave one, please let us know. Best, Henkjan Honing [1] https://peerj.com/articles/9414/ . University of Amsterdam Faculty of Humanities Faculty of Science www.mcg.uva<http://www.mcg.uva>.nl . =97=97 From: Ben <benjamin.glenn.schultz@xxxxxxxx<mailto:benjamin.glenn.schultz@xxxxxxxx= mail.com>> Subject: RE: Online rhythm production experiments Date: 20 October 2020 at 07:16:47 CEST To: Samuel Mehr <sam@xxxxxxxx<mailto:sam@xxxxxxxx>>, "AUDITOR= Y@xxxxxxxx<mailto:AUDITORY@xxxxxxxx>" <AUDITORY@xxxxxxxx= CA<mailto:AUDITORY@xxxxxxxx>>, Henkjan Honing <honing@xxxxxxxx<mailto:= honing@xxxxxxxx>> Hi Henkjan and list, I managed to get the latency and variability synced with audio/video down t= o the variability of the input device (~8ms for keyboards, larger for touch= screens and dependent on the model). I have integrated this with html and = javascript in Qualtrics and performed benchmark tests using an automated re= sponder. Response times do not appear to be affected by internet connection= speeds (but I have not yet tried dial-up). I am in the process of writing the manuscript with the benchmarks for publi= cation and the scripts will be open-source. These could be adapted for any = webpage. Best regards, Ben From: "Jacoby, Nori" <nori.jacoby@xxxxxxxx<mailto:nori.jacoby@xxxxxxxx>> Subject: Re: Online rhythm production experiments Date: 20 October 2020 at 16:10:20 CEST To: <AUDITORY@xxxxxxxx<mailto:AUDITORY@xxxxxxxx>> Reply-To: "Jacoby, Nori" <nori.jacoby@xxxxxxxx<mailto:nori.jacoby@xxxxxxxx= E>> Hi Henkjan and everybody, My research group has developed a technology that has solved this problem a= nd allowed us to collect reliable tapping data in an online setup. We=92ve = successfully collected large tapping datasets this way, and we believe that= our method fully addresses the issues mentioned in this thread (low latenc= y and jitter) while also being practical in terms of realistic online data = collection. We plan to publish a preprint by the end of the year and theref= ore make the details of the technology accessible to everyone soon. If you = are interested in using the technology earlier, please contact me. Very best, Nori Jacoby Max Planck Group Leader, =93Computational Auditory Perception=94 Max Planck Institute for Empirical Aesthetics Gr=FCneburgweg 14, 60322 Frankfurt am Main, Germany nori.jacoby@xxxxxxxx<mailto:nori.jacoby@xxxxxxxx> +49 69 8300479-820 -- Nori Jacoby Max Planck Group Leader, =93Computational Auditory Perception<https://www.a= esthetics.mpg.de/forschung/forschungsgruppe-computational-auditory-percepti= on.html>=94 Max Planck Institute for Empirical Aesthetics Gr=FCneburgweg 14, 60322 Frankfurt am Main, Germany. --_000_3b7a72638f5048f188f853b70ff0a819aempgde_ Content-Type: text/html; charset="windows-1250" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dwindows-1= 250"> <style type=3D"text/css" style=3D"display:none;"><!-- P {margin-top:0;margi= n-bottom:0;} --></style> </head> <body dir=3D"ltr"> <div id=3D"divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; color= :rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif,Helvetica,EmojiFont,&= quot;Apple Color Emoji&quot;,&quot;Segoe UI Emoji&quot;,NotoColorEmoji,&quo= t;Segoe UI Symbol&quot;,&quot;Android Emoji&quot;,EmojiSymbols"> <p></p> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> Dear auditory list,</div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> <br> </div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> We would like to share this preprint to present and validate a recently dev= eloped technology in our group: REPP (Rhythm ExPeriment Platform). This tec= hnology is able to measure SMS in online experiments with high temporal fid= elity while also working efficiently using hardware and software available to most participants online.&nbsp; W= e give details on the technology in the preprint as well as validate it in = a series of calibration and behavioral experiments. We demonstrate that our= technology achieves high temporal accuracy (latency and jitter within 2 ms on average) and high test-retest reliabili= ty both in the laboratory and online.&nbsp; We plan to release this technol= ogy as a free and open-source framework alongside the journal version of th= e paper.&nbsp;</div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> <br> </div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> This technology is fully automated and customizable, enabling researchers t= o monitor online experiments in real time and to implement a wide variety o= f SMS paradigms. For example, using REPP we successfully replicated online = a transmission chain experiment to estimate perceptual priors for simple rhythms via iterated reproduction= of random temporal sequences. In a recent paper, we also show that REPP ca= n be used to collect a large tapping dataset with more than 500 participant= s to study individual differences on SMS in the general population (Niarchou et al., 2021). We therefore bel= ieve this technology can support SMS experiments that would be nearly impos= sible in the lab while massively increasing the scalability and speed of da= ta collection.&nbsp;</div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> <br> </div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px"> https://www.biorxiv.org/content/10.1101/2021.01.15.426897v2</div> <br style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; font= -size:16px"> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px; margin-top:0px; margin-bottom:0px"> &nbsp;</div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px; margin-top:0px; margin-bottom:0px"> Very best,</div> <div style=3D"font-family:Calibri,Helvetica,sans-serif,serif,EmojiFont; fon= t-size:16px; margin-top:0px; margin-bottom:0px"> Nori Jacoby, Manuel&nbsp;Anglada-Tort, Peter Harrison</div> <br> <p></p> <p><br> </p> <div id=3D"Signature"> <div id=3D"divtagdefaultwrapper" dir=3D"ltr" style=3D"font-size:12pt; color= :rgb(0,0,0); font-family:Calibri,Helvetica,sans-serif,Helvetica,EmojiFont,&= quot;Apple Color Emoji&quot;,&quot;Segoe UI Emoji&quot;,NotoColorEmoji,&quo= t;Segoe UI Symbol&quot;,&quot;Android Emoji&quot;,EmojiSymbols"> <p></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Nori Jacoby</span>= </p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Max Planck Group L= eader, =93Computational Auditory Perception=94</span></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Max Planck Institu= te for Empirical Aesthetics</span></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline; font-size:9pt">Gr=FCneburgweg 14,= 60322 Frankfurt am Main, Germany</span></p> <p dir=3D"ltr" style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38= "><span style=3D"vertical-align:baseline"><a href=3D"mailto:nori.jacoby@xxxxxxxx= mpg.de" title=3D"mailto:nori.jacoby@xxxxxxxx Cmd&#43;Click or tap to follo= w the link" id=3D"LPNoLP" style=3D""><span style=3D"font-size:9pt">nori.jac= oby@xxxxxxxx</span></a><span style=3D"font-size:9pt"> </span><span style=3D"font-size:9pt">&#43;49 69 8300479-820</span><font col= or=3D"#1155cc" face=3D"Arial"></font> </span></p> <p></p> </div> </div> <div style=3D"color:rgb(0,0,0)"> <div> <div dir=3D"ltr"><br> <br> <div class=3D"gmail_quote"> <div dir=3D"ltr" class=3D"gmail_attr">---------- Forwarded message --------= -<br> From: <strong class=3D"gmail_sendername" dir=3D"auto">Prof. dr Henkjan Honi= ng</strong> <span dir=3D"auto">&lt;<a href=3D"mailto:honing@xxxxxxxx">honing@xxxxxxxx</a>&g= t;</span><br> Date: Mon, Oct 26, 2020 at 5:24 AM<br> Subject: [AUDITORY] Online rhythm production experiments: Update<br> To: <a href=3D"mailto:AUDITORY@xxxxxxxx">AUDITORY@xxxxxxxx</a= > &lt;<a href=3D"mailto:AUDITORY@xxxxxxxx">AUDITORY@xxxxxxxx<= /a>&gt;<br> </div> <br> <br> <div style=3D"word-wrap:break-word; line-break:after-white-space"> <div style=3D"word-wrap:break-word; line-break:after-white-space"> <div><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">Thanks fo= r the suggestions. Below a brief summary of the responses I received. These= came in three flavors:</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">1) soluti= ons suggesting <b>specific hardware</b> at the client side (e.g. using e.g., a two channel= audio card)</div> <div style=3D"word-wrap:break-word; line-break:after-white-space">2)&nbsp;s= olutions&nbsp;using <b>client side software</b> (e.g., javascript)</div> <div style=3D"word-wrap:break-word; line-break:after-white-space">3) offlin= e and/or <b>post-processing</b> solutions</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">For our p= urpose (relatively large-scale online rhythm production experiments) <b>solution type 1</b> is unrealistic.&nbsp;</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><i>[input= from Werner Hemmert and others]</i></div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><b>Soluti= on type 2</b> was tried by several researchers/institutes (using, e.g, Psyc= hoPY javascript, etc.). However, most report - as expected - relatively lar= ge timing errors, largely due to keyboard scan rates, drivers, and/or operating system (as reported in the reference= s mentioned in the original message). (Despite the claim of <a href=3D"http://psychopy.org" target=3D"_blank">psychopy.org</a> of &lt;4= ms precision in online studies).&nbsp;</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><i>[Input= from Ignacio Spiousas, Nick Haywood, Ben Schultz, Kyle Jasmin and others]<= /i></div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><b>N.B. <= /b>PeerJ recently published a comparative study [1]</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><b>Soluti= on type 3</b> was suggested by some: i.e. o record the rhythmic pattern by = tapping e.g. with a pencil on your desk or device microphone, along with th= e streamed sound, at the client side, upload the resulting audio file using a standard browser, and analyse it a= t the serverside using onset-detection and some crosscorrelation techniques= . Depending on the sampling rate, latencies can be reduced to 1 ms or less.= &nbsp;</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><i>[Input= from Roger Dannenberg,&nbsp;Krzysztof Basi=F1ski, Justin London and others= ]&nbsp;</i></div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">N.B.1 Ben= Schultz announced to make his version of Solution type 1 available as open= source (repeated below).</div> <div style=3D"word-wrap:break-word; line-break:after-white-space">N.B.2. No= ri Jacoby announced to make their version of Solution type 3 available as a= ppendix to a forthcoming paper (repreated below).</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">Neverthel= ess, my hope is still on some elegant solution of type 2. If you have one, = please let us know.</div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">Best,</di= v> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div><i>Henkjan Honing</i></div> <div><br> </div> <div>[1]&nbsp;<a href=3D"https://peerj.com/articles/9414/" target=3D"_blank= ">https://peerj.com/articles/9414/</a></div> <div> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"color:rgb(0,0,0); letter-spacing:normal; text-al= ign:start; text-indent:0px; text-transform:none; white-space:normal; word-s= pacing:0px; text-decoration:none; word-wrap:break-word; line-break:after-wh= ite-space"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"word-wrap:break-word; line-break:after-white-spa= ce"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"word-wrap:break-word; line-break:after-white-spa= ce"> <div style=3D"text-align:start; text-indent:0px"> <div style=3D"margin-bottom:0px; margin-top:0px"> <div dir=3D"auto" style=3D"text-align:start; text-indent:0px; word-wrap:bre= ak-word; line-break:after-white-space"> <div dir=3D"auto" style=3D"word-wrap:break-word; line-break:after-white-spa= ce"> <div style=3D"margin-bottom:0px; margin-top:0px"> <div style=3D"color:rgb(0,0,0); font-style:normal; letter-spacing:normal; t= ext-transform:none; white-space:normal; word-spacing:0px; text-decoration:n= one; font-family:Courier; font-size:14px"> <div><span style=3D"font-size:10px; color:rgb(102,102,102); font-family:Cal= ibri">.</span></div> </div> <div style=3D"color:rgb(0,0,0); font-style:normal; letter-spacing:normal; t= ext-transform:none; white-space:normal; word-spacing:0px; text-decoration:n= one; font-family:Courier; font-weight:normal"> <span style=3D"font-weight:bold; color:rgb(102,102,102); font-family:Calibr= i; font-size:12px">University of Amsterdam</span></div> <div style=3D"color:rgb(0,0,0); font-style:normal; letter-spacing:normal; t= ext-transform:none; white-space:normal; word-spacing:0px; text-decoration:n= one; font-family:Courier; font-weight:normal"> <span style=3D"color:rgb(102,102,102); font-family:Calibri; font-size:12px"= >Faculty of Humanities&nbsp;</span></div> <div style=3D"color:rgb(0,0,0); font-style:normal; letter-spacing:normal; t= ext-transform:none; white-space:normal; word-spacing:0px; text-decoration:n= one; font-family:Courier; font-weight:normal"> <span style=3D"color:rgb(102,102,102); font-family:Calibri; font-size:12px"= >Faculty of Science</span></div> <div style=3D"color:rgb(0,0,0); font-style:normal; letter-spacing:normal; t= ext-transform:none; white-space:normal; word-spacing:0px; text-decoration:n= one; font-family:Courier; font-weight:normal"> <span style=3D"color:rgb(102,102,102); font-family:Calibri; font-size:12px"= ><a href=3D"http://www.mcg.uva" target=3D"_blank">www.mcg.uva</a>.nl</span>= </div> <div style=3D"color:rgb(0,0,0); font-style:normal; letter-spacing:normal; t= ext-transform:none; white-space:normal; word-spacing:0px; text-decoration:n= one; font-family:Courier; font-weight:normal"> <span style=3D"font-size:10px; color:rgb(102,102,102); font-family:Calibri"= >.</span></div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> </div> <br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space">=97=97</d= iv> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space"> <blockquote type=3D"cite"> <div style=3D"margin:0px"><span style=3D""><b>From:&nbsp;</b></span><span s= tyle=3D"">Ben &lt;<a href=3D"mailto:benjamin.glenn.schultz@xxxxxxxx" targe= t=3D"_blank">benjamin.glenn.schultz@xxxxxxxx</a>&gt;<br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>Subject:&nbsp;</b></span><spa= n style=3D""><b>RE: Online rhythm production experiments</b><br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>Date:&nbsp;</b></span><span s= tyle=3D"">20 October 2020 at 07:16:47 CEST<br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>To:&nbsp;</b></span><span sty= le=3D"">Samuel Mehr &lt;<a href=3D"mailto:sam@xxxxxxxx" target=3D"_b= lank">sam@xxxxxxxx</a>&gt;, &quot;<a href=3D"mailto:AUDITORY@xxxxxxxx= CGILL.CA" target=3D"_blank">AUDITORY@xxxxxxxx</a>&quot; &lt;<a href= =3D"mailto:AUDITORY@xxxxxxxx" target=3D"_blank">AUDITORY@xxxxxxxx= L.CA</a>&gt;, Henkjan Honing &lt;<a href=3D"mailto:honing@xxxxxxxx" target=3D"_blank">honi= ng@xxxxxxxx</a>&gt;<br> </span></div> <br> <div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">H= i Henkjan and list,</div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif"><= u></u>&nbsp;<u></u></div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">I= managed to get the latency and variability synced with audio/video down to= the variability of the input device (~8ms for keyboards, larger for touch = screens and dependent on the model). I have integrated this with html and javascript in Qualtrics and performed= benchmark tests using an automated responder. Response times do not appear= to be affected by internet connection speeds (but I have not yet tried dia= l-up).</div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif"><= u></u>&nbsp;<u></u></div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">I= am in the process of writing the manuscript with the benchmarks for public= ation and the scripts will be open-source. These could be adapted for any w= ebpage.&nbsp;</div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif"><= u></u>&nbsp;<u></u></div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">B= est regards,</div> <div style=3D"margin:0cm; font-size:11pt; font-family:Calibri,sans-serif">B= en</div> </div> </blockquote> <br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space"><br> </div> <div style=3D"word-wrap:break-word; line-break:after-white-space"> <blockquote type=3D"cite"> <div style=3D"margin:0px"><span style=3D""><b>From:&nbsp;</b></span><span s= tyle=3D"">&quot;Jacoby, Nori&quot; &lt;<a href=3D"mailto:nori.jacoby@xxxxxxxx= .DE" target=3D"_blank">nori.jacoby@xxxxxxxx</a>&gt;<br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>Subject:&nbsp;</b></span><spa= n style=3D""><b>Re: Online rhythm production experiments</b><br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>Date:&nbsp;</b></span><span s= tyle=3D"">20 October 2020 at 16:10:20 CEST<br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>To:&nbsp;</b></span><span sty= le=3D"">&lt;<a href=3D"mailto:AUDITORY@xxxxxxxx" target=3D"_blank">A= UDITORY@xxxxxxxx</a>&gt;<br> </span></div> <div style=3D"margin:0px"><span style=3D""><b>Reply-To:&nbsp;</b></span><sp= an style=3D"">&quot;Jacoby, Nori&quot; &lt;<a href=3D"mailto:nori.jacoby@xxxxxxxx= .MPG.DE" target=3D"_blank">nori.jacoby@xxxxxxxx</a>&gt;<br> </span></div> <br> <div> <div style=3D"margin-top:0px; margin-bottom:0px">Hi&nbsp;Henkjan and everyb= ody,<br> <br> My research group has developed a technology that has solved this problem a= nd allowed us to collect reliable tapping data in an online setup. We=92ve = successfully&nbsp;collected large tapping datasets this way, and we believe= that our method fully addresses the issues mentioned in this thread (low latency and jitter) while also being practic= al in terms of realistic online data collection. We plan to publish a prepr= int by the end of the year and therefore make the details of the technology= accessible to everyone soon. If you are interested in using the technology earlier, please contact me.<br> <br> Very best,<br> Nori Jacoby<br> </div> <div style=3D"margin-top:0px; margin-bottom:0px; font-family:Calibri,Helvet= ica,sans-serif,Helvetica,EmojiFont,&quot;Apple Color Emoji&quot;,&quot;Sego= e UI Emoji&quot;,NotoColorEmoji,&quot;Segoe UI Symbol&quot;,&quot;Android E= moji&quot;,EmojiSymbols; font-size:12pt"> <br> </div> <div id=3D"m_-6722186840014274125Signature" style=3D"font-family:Calibri,He= lvetica,sans-serif,Helvetica,EmojiFont,&quot;Apple Color Emoji&quot;,&quot;= Segoe UI Emoji&quot;,NotoColorEmoji,&quot;Segoe UI Symbol&quot;,&quot;Andro= id Emoji&quot;,EmojiSymbols; font-size:12pt"> <div id=3D"m_-6722186840014274125divtagdefaultwrapper" dir=3D"ltr" style=3D= "font-size:12pt"> <div style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38"><span st= yle=3D"vertical-align:baseline; font-size:9pt">Max Planck Group Leader, =93= Computational Auditory Perception=94</span></div> <div style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38"><span st= yle=3D"vertical-align:baseline; font-size:9pt">Max Planck Institute for Emp= irical Aesthetics</span></div> <div style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38"><span st= yle=3D"vertical-align:baseline; font-size:9pt">Gr=FCneburgweg 14, 60322 Fra= nkfurt am Main, Germany</span></div> <div style=3D"margin-top:0pt; margin-bottom:0pt; line-height:1.38"><span st= yle=3D"vertical-align:baseline"><a href=3D"mailto:nori.jacoby@xxxxxxxx" ti= tle=3D"mailto:nori.jacoby@xxxxxxxx Cmd&#43;Click or tap to follow the link= " id=3D"m_-6722186840014274125LPNoLP" target=3D"_blank"><span style=3D"font= -size:9pt">nori.jacoby@xxxxxxxx</span></a><span style=3D"font-size:9pt">&n= bsp;</span><span style=3D"font-size:9pt">&#43;49 69 8300479-820</span></span></div> </div> </div> </div> </blockquote> </div> </div> </div> <br clear=3D"all"> <div><br> </div> -- <br> <div dir=3D"ltr" class=3D"gmail_signature"> <div dir=3D"ltr"><font size=3D"1">Nori Jacoby<br> Max Planck Group Leader, =93<a href=3D"https://www.aesthetics.mpg.de/forsch= ung/forschungsgruppe-computational-auditory-perception.html" target=3D"_bla= nk">Computational Auditory Perception</a>=94<br> Max Planck Institute for Empirical Aesthetics<br> Gr=FCneburgweg 14, 60322 Frankfurt am Main, Germany.&nbsp;</font></div> </div> </div> </div> </div> </div> </body> </html> --_000_3b7a72638f5048f188f853b70ff0a819aempgde_--


This message came from the mail archive
src/postings/2021/
maintained by:
DAn Ellis <dpwe@ee.columbia.edu>
Electrical Engineering Dept., Columbia University