Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of trust (Les Bernstein )


Subject: Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of trust
From:    Les Bernstein  <lbernstein@xxxxxxxx>
Date:    Wed, 7 Jun 2023 10:19:36 -0400

--------------eXkqIu2Qy0cV30rTRraY0zgw Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by edgeum4.it.mcgill.ca id 357EJv8f103939 Ah, the same ChatGPT that gave us this=20 <https://www.nytimes.com/2023/05/27/nyregion/avianca-airline-lawsuit-chat= gpt.html>.=F0=9F=98=81 Les On 6/6/2023 11:26 PM, Brent Edwards wrote: > *** Attention: This is an external email. Use caution responding,=20 > opening attachments or clicking on links. *** > Here=E2=80=99s what chatGPT has to say about arXiv vs peer review: > > I recognize the value of both preprint online archives like arXiv and=20 > peer-reviewed publication in journals. Each has its unique benefits=20 > and considerations, and understanding their respective values is=20 > crucial for disseminating research findings effectively. > > Preprint online archives, such as arXiv, offer several advantages that=20 > make them valuable for researchers. Firstly, they provide a platform=20 > for researchers to share their work with the scientific community=20 > quickly. This allows for rapid dissemination of research findings and=20 > facilitates collaboration, as fellow researchers can access and=20 > provide feedback on the preprint. This open and transparent approach=20 > to sharing scientific knowledge encourages discussions and the=20 > exchange of ideas, fostering scientific progress. > > Another significant benefit of preprint archives is that they offer a=20 > chance to receive feedback on research before formal peer review. This=20 > can be particularly useful in refining the work, identifying potential=20 > flaws or limitations, and strengthening the overall research design.=20 > Feedback received through the preprint process can contribute to=20 > improving the research before submitting it to a peer-reviewed journal. > > Furthermore, posting a preprint on an online archive establishes a=20 > clear and early record of priority and intellectual ownership. In=20 > highly competitive research fields, where multiple groups might be=20 > working on similar projects simultaneously, this can be crucial for=20 > establishing precedence. > > On the other hand, peer-reviewed publication in journals remains a=20 > vital aspect of scientific research and academic advancement. Peer=20 > review provides a rigorous evaluation process by experts in the field,=20 > ensuring the quality, validity, and reliability of the research.=20 > Through this process, potential flaws, errors, or biases can be=20 > identified and addressed, resulting in higher-quality publications. > > Publishing in reputable peer-reviewed journals also adds a stamp of=20 > approval and credibility to the research. It signifies that the work=20 > has met the standards of the scientific community and has undergone=20 > rigorous scrutiny. This validation is particularly important for=20 > researchers seeking tenure, promotions, or funding, as it carries=20 > weight in the academic community. > > Moreover, journals often have wider readership and visibility than=20 > preprint archives, making it more likely that the research will reach=20 > a broader audience. Journal publications are often indexed in=20 > databases and search engines, which facilitate discoverability and=20 > citation by other researchers. This, in turn, can enhance the=20 > researcher's reputation, impact, and career progression. > > In summary, preprint online archives like arXiv offer rapid=20 > dissemination, early feedback, and a transparent platform for sharing=20 > research, fostering collaboration and discussion within the scientific=20 > community. Peer-reviewed publication in journals, on the other hand,=20 > provides a rigorous evaluation process, validation, credibility, wider=20 > readership, and increased visibility. Recognizing the value of both=20 > avenues, researchers often utilize preprint archives to share early=20 > versions of their work while working towards the goal of journal=20 > publication to receive formal recognition and validation. > > > =E2=80=94Brent > On 6 Jun 2023 at 7:39 PM +1000, Jan Schnupp=20 > <000000e042a1ec30-dmarc-request@xxxxxxxx>, wrote: >> I guess if reputation biases peer review as heavily as the consensus=20 >> seems to think here, then what does the often pretty hard time I get=20 >> from my reviewers tell me about my reputation? ... =F0=9F=A4=94=F0=9F=98= =9D >> >> Jan >> >> On Tue, 6 Jun 2023, 17:17 Peter Harrison, <pmch2@xxxxxxxx> wrote: >> >> Dear all, >> >> Several colleagues have mentioned how peer review is unduly >> biased by the reputation of the authors/institutions. I agree >> that this is an important problem, but it's only fair to observe >> that it applies to preprints too. In a world where we don't have >> time to read every preprint, many people will still end up using >> imperfect proxies for deciding what to read, such as the >> reputation of the authors/institutions. In the absence of a >> journal's mark of approval, these imperfect proxies could grow >> more influential, not less influential. >> >> Best wishes >> Peter >> ------------------------------------------------------------------= ------ >> *From:* AUDITORY - Research in Auditory Perception >> <AUDITORY@xxxxxxxx> on behalf of Helia Relano Iborra >> <0000017f74f788f8-dmarc-request@xxxxxxxx> >> *Sent:* 06 June 2023 09:21 >> *To:* AUDITORY@xxxxxxxx <AUDITORY@xxxxxxxx> >> *Subject:* Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of >> trust >> >> Dear Brian, all, >> >> Thank you for a very enriching discussion. I just wanted to >> counter Brian=E2=80=99s last email, regarding the neutrality of pe= er >> review. There is extensive evidence of =E2=80=9Cstatus bias=E2=80=9D= in the >> peer-review system in studies comparing single-blind vs >> double-blind reviews. E.g. Huber et al. (2022) >> https://www.pnas.org/doi/10.1073/pnas.2205779119 >> <https://urldefense.com/v3/__https://www.pnas.org/doi/10.1073/pnas= .2205779119__;!!Cn_UX_p3!hQG4VnqUSkjUxB_2-8_weCdic9HBEKKig8nWowxLkr_YPeIH= TZKV4PBufa3nQ74AwuKvxBhaeDUhFdLu$> >> or Blank (1991) https://www.jstor.org/stable/2006906 >> <https://urldefense.com/v3/__https://www.jstor.org/stable/2006906_= _;!!Cn_UX_p3!hQG4VnqUSkjUxB_2-8_weCdic9HBEKKig8nWowxLkr_YPeIHTZKV4PBufa3n= Q74AwuKvxBhaeD7Se3ou$>. >> No system (or person) is free of bias, unfortunately. I think >> recognizing that these biases exist and being aware of them when >> we are reviewing manuscripts can only make us better reviewers. >> >> Best, >> >> Helia. >> >> <> >> >> =09 >> >> *Helia Rela=C3=B1o Iborra* >> >> Postdoc >> >> Hearing Systems Section >> >> Department of Health Technology >> >> heliaib@xxxxxxxx <mailto:heliaib@xxxxxxxx> >> >> =C3=98rsteds Plads >> >> Building 352 >> >> 2800=C2=A0Kgs. Lyngby >> >> www.dtu.dk/english >> <https://urldefense.com/v3/__https://www.dtu.dk/english__;!!Cn_UX_= p3!hQG4VnqUSkjUxB_2-8_weCdic9HBEKKig8nWowxLkr_YPeIHTZKV4PBufa3nQ74AwuKvxB= haeFMz9jY_$> >> >> *From:* AUDITORY - Research in Auditory Perception >> <AUDITORY@xxxxxxxx> *On Behalf Of* Brian FG Katz (SU) >> *Sent:* 6. juni 2023 09:27 >> *To:* AUDITORY@xxxxxxxx >> *Subject:* Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of >> trust >> >> Dear Bob, et al, >> >> I feel obliged to reply to some serious statements made in recent >> posts. While i think there is little doubt that numerous bias >> elements (privileges of various sorts" are present in career >> evolutions, recruitment committees, promotions, be them academic >> or corporate, I must return to the discussion to the topic at >> hand, in the broad sense, of the importance of peer-review. >> >> As a regular reviewer in various journals (and fields of >> acoustics) what is judged is the work on the page, no more and no >> less. No free rides are given to authors of high reputation >> (sometime more scrutiny), nor penalties to young unknowns or >> unrepresented countries (sometimes more flexibility is given). If >> the arguement for publication is unpersuasive, it is solely on >> the merit of the presentation of the work. I say it this way >> because again it is only what is on the page that is reviewed. >> The work itself may be of high standards, but a work is reviewed >> by what is stated, not what is intended. As an Associate Editor, >> the same is true. Specific knowledge of the author is really only >> needed to assure lack of direct conflicts of interest in >> selecting reviewers. I have never considered the background,=C2=A0 >> academic or career history of an author in accepting or rejecting >> a manuscript. I would even go so far as to say if one considers >> these elements in one's reviews they should probably recuse >> themselves from such benevolent activities to the community. >> >> Finally, returning to the question of arXiv and preprints, where >> this all started, I don't think anyone came out against them on >> the whole, but they should be taken for what they are, and no >> more. They are a scientific blog or a conference proceeding. They >> do not hold the same value, or represent the same rigor of >> critique, that a journal article has passed. Thie difference is >> clear. However, it is only really relevant in a few >> circumstances: as a substantive citation in another journal >> article, in an academic/research career application/review, or a >> project proposal (a version of the previous point). If one >> doesn't require these elements, and that is a choice, then one >> isn't limited by the means one chooses to disseminate one's work. >> No one has critiqued the use of arxiv and the like, per se,=C2=A0 = but >> if one is competing on the quality of one's work, the process of >> peer-review is the widely accepted passage for some semblance of >> quality, for which no other alternative currently exists. A >> review committee cannot be expected to read every article, let >> alone the comments section, and be required to form an opinion. >> >> This does not say the process cannot be improved, and that is >> also the motivation for journal quality classifications and the >> exclusion of some journals from being "acceptable" is those >> situations. Such rapid publication and limited review journals >> are more akin to arXiv than a reputable journal, though with >> fees, and rightly so with regards to scientific scrutiny. One is >> free to use them for what they are, but one should not make >> claims that they are anything more. >> >> At least, that is my perspective. >> >> -- >> >> Brian FG Katz >> >> Equipe LAM : Lutheries Acoustique Musique >> >> Sorbonne Universit=C3=A9, CNRS, Institut =E2=88=82'Alembert >> >> -------- Original message -------- >> >> From: "McMurray, Bob" <bob-mcmurray@xxxxxxxx> >> >> Date: 6/6/23 06:09 (GMT+01:00) >> >> To: AUDITORY@xxxxxxxx >> >> Subject: Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of tru= st >> >> Hi Colleagues >> >> I=E2=80=99ve been watching from the wings on this discussion as I = think >> our field is in a real point of flux with respect to scientific >> publishing and communication, and I don=E2=80=99t think I know wha= t=E2=80=99s >> best any more. =C2=A0=C2=A0Its been fun to watch a very healthy an= d >> vigorous conversation unfold amonst my esteemed colleagues =E2=80=93= both >> junior and senior =E2=80=93 and I=E2=80=99ve learned a lot. >> >> However, Matt (and Deniz) made a very powerful point, that I felt >> the need to weigh in on.=C2=A0 They argue that the very nature of >> scientific communication is pervaded by issues power, >> positionality and discrimination. I don=E2=80=99t think I realized= this >> till recently (perhaps I was an Eagle in that cartoon), but they >> are right. It=E2=80=99s important. >> >> Les, I respect your point of view.=C2=A0 We should be having these >> open and objective conversations and we should strive for that.=C2= =A0 >> But we also have to recognize that this is an aspirational point >> of view.=C2=A0 In my view, the rhetoric of science is not objectiv= e. >> Its persuasive.=C2=A0 A scientific discovery from my lab is not a = fact >> until I convince the scientific community to believe it (or at >> least convince Reviewers 1,2 and 3).=C2=A0 The rules of science =E2= =80=93 >> statistical and methodological norms, peer review, and the like >> -- are really designed to ensure that this persuasion is all >> geared to some mutually acceptable norms of objectivity.=C2=A0 It >> often works and there=E2=80=99s not much better. >> >> But fundamentally this is still a persuasive enterprise (as it >> should be). And fundamentally, some people =E2=80=93 by virtue of = their >> station and background =E2=80=93 are going to be in a better place= to >> persuade their colleagues than others.=C2=A0 We commonly associate >> these issues of discrimination and positionality with things like >> race, religion and gender.=C2=A0 And indeed these things matter =E2= =80=93 just >> look at the disparities among the medalists of the ASA and you >> can see for yourself. >> >> But a good friend of mine recently showed me how these kind of >> factors extend all throughout academia.=C2=A0 Are some fields >> privileged?=C2=A0 Are hearing scientists more likely to discount a >> finding from a linguist or a social scientist than someone who is >> solidly situated in hearing science?=C2=A0 What about a finding fr= om a >> small clinical population (a =E2=80=9Cniche=E2=80=9D field) or an = obscure >> auditory phenomena vs. as opposed to a finding based on the core >> =E2=80=9Cmodal=E2=80=9D NH adult in a sound proof booth?=C2=A0 Are= we more likely to >> take a finding seriously if it was generated by one of the top >> universities (in our field) than a second tier state university?=C2= =A0 >> Or from a new scholar that was trained by one of the best vs. an >> emerging scholar who came to the field more independently? What >> about a person who is changing fields =E2=80=93 migrating, for exa= mple, >> from a field like cognitive science to audiology or hearing >> science?=C2=A0 What about clinical credentialing?=C2=A0 Does that = help or >> harm our cases? >> >> All of these things have nothing to do with the objective >> argument that is being made and the quality of the data used to >> support it.=C2=A0 But we all must admit that they do change how mu= ch >> credence we are likely to give a discussion or a paper (and each >> of us may weigh these differently).=C2=A0 Sometimes these are usef= ul >> heuristics =E2=80=93 if the methods aren=E2=80=99t clear, but you = know how a >> person was trained, it may be easier to trust that the >> experiments were done right.=C2=A0 But sometimes this is just >> downright discriminatory, like when we discount contributions >> from outside what we perceive as the core field. >> >> But how does this impact scientific publishing? >> >> Matt makes the valuable point that as our field opens up to new >> viewpoints and new participants, the view from those people may >> be very different than the view from the people at the top.=C2=A0 = We >> should listen. People do struggle to gain entry to this field.=C2=A0= I >> certainly did when I began working in hearing science, despite my >> training at a very good cognitive science program. >> >> Peer review is part of the problem.=C2=A0 It can amplify these >> biases.=C2=A0 And peer review is not designed to =E2=80=9Chelp=E2=80= =9D new entries =E2=80=93 >> its is designed to help a journal editor decide what to do with a >> paper. So it often serves as an impersonal barrier to entry.=C2=A0= OF >> course, we cannot dispense with it.=C2=A0 But we should be activel= y >> exploring other models.=C2=A0 if this new generation of talented, >> thoughtful, diverse and enterprising young scholars wants to >> engage in novel modes of scientific communication, I=E2=80=99m hap= py to >> listen and to contribute to these new models. >> >> theBob >> >> On Thu, Jun 1, 2023 at 1:55=E2=80=AFPM Les Bernstein >> <lbernstein@xxxxxxxx> wrote: >> >> On 5/31/2023 2:15 PM, Matthew Winn wrote: >> >> *** Attention: This is an external email. Use caution >> responding, opening attachments or clicking on links. *** >> >> There are statements in this thread that cannot go >> unchallenged, because they condone and perpetuate harmful >> ideas that need to end. Specifically: >> 1) =E2=80=9CIf one is not a sufficiently confident and >> independent thinker such that one can express ideas, >> arguments, disagreements, etc. with anyone in the field, >> regardless of stature, then that is a weakness=E2=80=9D >> This statement ignores the multiple power structures that >> affect the lives and employment of those below the =E2=80=98= upper >> echelon=E2=80=99 in the field. Expressing an idea involves= risk >> when your position is precarious. Adapting to and >> weighing that risk is a key survival strategy, not a >> weakness. I have a blind spot for this risk =E2=80=93 not = because >> I=E2=80=99m so great at science, but because my culture gi= ves me >> unearned respect because of my demographics. For people >> like me (and, I will note, virtually everyone on this >> thread), we live in a culture that insulates us from any >> sense that our voice doesn=E2=80=99t belong. >> >> >> I could not disagree more.=C2=A0 The suggestion that, within o= ur >> field, different cultural backgrounds confer more or less >> ability to have productive scientific discussions with >> anyone, regardless of status is, as I see it, just plain >> nonsense. Expressing an idea involves risk? Really, in our >> field of auditory science?=C2=A0 I can give plenty of >> counterexamples to such an assertion. >> >> >> >> 2) =E2=80=9Cthink about how such researchers earned such s= tatus. >> It was not because they had friends, it was not because >> people liked them.=C2=A0 It was because they established a >> track-record of contributions that the field, in general, >> held in very high regard.=E2=80=9D >> This is a self-serving narrative that reflects >> survivorship bias and which ignores everything we know >> about how people act in real life. Science is done by >> humans, who have personal interests, biases, and who live >> within a culture where status is built on many layers of >> privilege. Every decision we make is filtered by these >> factors, which allow some people (like me) to accumulate >> a variety of advantages at every career stage, simply >> because of how they look, who their friends are, and >> where they grew up. They are more likely to have papers >> accepted, to be selected for podium presentations, to >> have a job application reviewed, to be interviewed, to be >> hired, to be selected as editors and reviewers, to be >> elected to positions of leadership, and to be given >> favorable treatment in the workplace. To be taken >> seriously. If we pretend that these advantages are ALL >> due to the scientific merit of one=E2=80=99s work, we are >> characterizing scientists as some species entirely >> separate from the rest of humanity. >> >> Again, theoretical, social drivel.=C2=A0 Lloyd Jeffress, Dave >> Green, Neal Viemester, Barbara Bohne, and on and on. >> >> >> >> 3) =E2=80=9CStature does not count. Everyone should be hel= d to >> the very same standard=E2=80=9D >> We all agree that work should not be judged on the basis >> of who wrote it. But importantly, the influence of >> stature doesn=E2=80=99t need to be explicitly suggested in= order >> to actually take place. Similar to the last point, the >> idea of equal standards and equal treatment is a >> convenient fiction that allows people like me to feel >> superior because I can attribute my success to my own >> hard work and merit, even though many factors that led to >> that success were unearned. >> >> Again, your theoretical musing.=C2=A0 Not the reality in audit= ory >> science that I have seen. >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D >> What does this have to do with preprints? The point is to >> consider that others have a different set of constraints, >> and that our definitions of merit are tailored to suit >> those who are already enjoying a wide variety of >> privileges. Consider the forces that lead authors to >> think that preprints are useful, and also whether you are >> facing the same expectations and constraints that they >> are. Numerous people have pointed at the apparent >> generational divide on this issue - let's figure out why. >> Graduate admissions and fellowship review increasingly >> expect a publication record that far exceeds anything >> that would have been expected of the reviewers when they >> were at that same career stage. For various reasons, the >> timeline of publication is increasingly long. >> Exacerbating this, it is no longer enough to simply >> conduct a good study; one must also curate a data >> management and sharing plan that includes open-access >> data and documented code. One must learn and conduct the >> latest statistical techniques that their advisors never >> needed to learn, and sift through a much broader set of >> literature that includes a lot of garbage. To compete for >> stable employment, younger scholars need an internet >> presence and must learn to incorporate inclusive language >> in their writing, even if that were not part of their >> training. They need to express how their work contributes >> to the reduction of harm in society, despite being >> advised by some of the people who are doing the harm. >> >> >> None of this, much of which I find to be mere unjustified >> assertion, is an argument for shifting the weight of >> dissemination of work toward non-refereed open access.=C2=A0 B= y >> the way, when was it the case that a solid knowledge of >> statistical techniques was unnecessary?=C2=A0 Hey, you don't h= ave >> to wire together analog equipment to generate your signals! >> >> >> Preprints are not a magical solution that can eliminate >> the multiple barriers that I described above. But they >> have tangible value, and reflect adaptation to a changing >> academic landscape, rather than reflecting some loss of >> =E2=80=9Cstandards=E2=80=9D that are designed to protect t= hose already at >> the top, and which were established under an entirely >> different system of constraints. >> >> >> Preprints help address the needs for 1) visibility and 2) >> quicker feedback on your work from a wider variety of >> scholars who might not have been invited to review, >> simply because they were not in the network of the >> associate editor. These factors are often yoked together; >> the channels that spread awareness of a preprint (like >> Twitter) might also be the same channels that generate >> discussion that becomes useful feedback. The tendency (or >> need) to use these dissemination channels probably >> reinforces the generational divide on this thread. I >> assure you that the comments I've received from people >> enthusiastic enough to read a preprint have had >> meaningful influence and value. And those comments can >> come from a wider variety of people whose opinions have >> been historically discounted. Experienced reviewers will >> always have a place in our scientific discourse, but to >> discount the benefit and potential of preprints is to be >> willfully detached from our current reality. >> >> >> I never said one should not use pre-prints for whatever >> benefit they can confer. >> >> >> Matt >> >> -- >> >> *Leslie R. Bernstein, Ph.D. |* Professor Emeritus >> >> Depts. of Neuroscience and Surgery (Otolaryngology) | UConn >> School of Medicine >> 263 Farmington Avenue, Farmington, CT 06030-3401 >> Office: 860.679.4622 | Fax: 860.679.2495 >> >> <> >> >> >> -- >> >> Matthew Winn, AuD, PhD >> >> Associate Professor >> >> Speech-Language-Hearing Sciences >> >> University of Minnesota >> --=20 *Leslie R. Bernstein, Ph.D. **| *Professor Emeritus Depts. of Neuroscience and Surgery (Otolaryngology) | UConn School of=20 Medicine 263 Farmington Avenue, Farmington, CT 06030-3401 Office: 860.679.4622 | Fax: 860.679.2495 --------------eXkqIu2Qy0cV30rTRraY0zgw Content-Type: multipart/related; boundary="------------vaFv16ojRxGvXXkPkNiF0rxY" --------------vaFv16ojRxGvXXkPkNiF0rxY Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-MIME-Autoconverted: from 8bit to quoted-printable by edgeum4.it.mcgill.ca id 357EJv8f103939 <html><head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dutf-8"> </head> <body> <div class=3D"moz-cite-prefix"><font size=3D"2" face=3D"Helvetica, Ar= ial, sans-serif">Ah, the same ChatGPT that gave us <a moz-do-not-send=3D= "true" href=3D"https://www.nytimes.com/2023/05/27/nyregion/avianca-airlin= e-lawsuit-chatgpt.html">this</a>.=F0=9F=98=81<br> <br> Les<br> </font><br> On 6/6/2023 11:26 PM, Brent Edwards wrote:<br> </div> <blockquote type=3D"cite" cite=3D"mid:a1fa9a98-9fc4-434c-a18c-aaa57dc= 89716@xxxxxxxx"> =20 <title></title> <div style=3D"background-color:#D5EAFF; padding:.8em; "> <div style=3D"font-size:12pt; color:#ff0000; text-align: center; font-family: 'Calibri',sans-serif;"> *** Attention: This is an external email. Use caution responding, opening attachments or clicking on links. ***</div> </div> <div> <div name=3D"messageBodySection"> <div dir=3D"auto">Here=E2=80=99s what chatGPT has to say about = arXiv vs peer review:<br> <br> <span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-= serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">I recognize the value of both preprint online archives like arXiv and peer-reviewed publication in journals. Each has its unique benefits and considerations, and understanding their respective values is crucial for disseminating research findings effectively.</span><span style=3D"font-size: 16px"><br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">Preprint online archives, such as arXiv, offer several advantages that make them valuable for researchers. Firstly, they provide a platform for researchers to share their work with the scientific community quickly. This allows for rapid dissemination of research findings and facilitates collaboration, as fellow researchers can access and provide feedback on the preprint. This open and transparent approach to sharing scientific knowledge encourages discussions and the exchange of ideas, fostering scientific progress.</span><span style=3D"font-si= ze: 16px"><br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">Another significant benefit of preprint archives is that they offer a chance to receive feedback on research before formal peer review. This can be particularly useful in refining the work, identifying potential flaws or limitations, and strengthening the overall research design. Feedback received through the preprint process can contribute to improving the research before submitting it to a peer-reviewed journal.</span><span style=3D"font-size: 16px= "><br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">Furthermore, posting a preprint on an online archive establishes a clear and early record of priority and intellectual ownership. In highly competitive research fields, where multiple groups might be working on similar projects simultaneously, this can be crucial for establishing precedence.</span><span sty= le=3D"font-size: 16px"><br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">On the other hand, peer-reviewed publication in journals remains a vital aspect of scientific research and academic advancement. Peer review provides a rigorous evaluation process by experts in the field, ensuring the quality, validity, and reliability of the research. Through this process, potential flaws, errors, or biases can be identified and addressed, resulting in higher-quality publications.</span>= <span style=3D"font-size: 16px"><br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">Publishing in reputable peer-reviewed journals also adds a stamp of approval and credibility to the research. It signifies that the work has met the standards of the scientific community and has undergone rigorous scrutiny. This validation is particularly important for researchers seeking tenure, promotions, or funding, as it carries weight in the academic community.</span><span style=3D"font-size: 16px"><= br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">Moreover, journals often have wider readership and visibility than preprint archives, making it more likely that the research will reach a broader audience. Journal publications are often indexed in databases and search engines, which facilitate discoverability and citation by other researchers. This, in turn, can enhance the researcher's reputation, impact, and career progression.</span><span style=3D"font-size: 16px"><br> </span><span style=3D"font-size: 16px"><br> </span><span style=3D"color:#374151;font-family:S=C3=B6hne, ui-sans-serif, system-ui, -apple-system, Segoe UI, Roboto, Ubuntu, Cantarell, Noto Sans, sans-serif, Helvetica Neue, Arial, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol, Noto Color Emoji;font-size: 16px">In summary, preprint online archives like arXiv offer rapid dissemination, early feedback, and a transparent platform for sharing research, fostering collaboration and discussion within the scientific community. Peer-reviewed publication in journals, on the other hand, provides a rigorous evaluation process, validation, credibility, wider readership, and increased visibility. Recognizing the value of both avenues, researchers often utilize preprint archives to share early versions of their work while working towards the goal of journal publication to receive formal recognition and validation.</span><span style=3D"fon= t-size: 16px"><br> </span><span style=3D"font-size: 16px"><br> </span></div> </div> <div name=3D"messageSignatureSection"><br> <div class=3D"matchFont">=E2=80=94Brent</div> </div> <div name=3D"messageReplySection">On 6 Jun 2023 at 7:39 PM +1000, Jan Schnupp <a class=3D"moz-txt-link-rfc2396E" href=3D"mailto:0= 00000e042a1ec30-dmarc-request@xxxxxxxx" moz-do-not-send=3D"true">&= lt;000000e042a1ec30-dmarc-request@xxxxxxxx&gt;</a>, wrote:<br> <blockquote type=3D"cite" style=3D"border-left-color: grey; border-left-width: thin; border-left-style: solid; margin: 5px 5px;padding-left: 10px;"> <div dir=3D"auto">I guess if reputation biases peer review as heavily as the consensus seems to think here, then what does the often pretty hard time I get from my reviewers tell me about my reputation? ... =F0=9F=A4=94=F0=9F=98=9D <div dir=3D"auto"><br> </div> <div dir=3D"auto">Jan&nbsp;</div> </div> <br> <div class=3D"gmail_quote"> <div dir=3D"ltr" class=3D"gmail_attr">On Tue, 6 Jun 2023, 17:17 Peter Harrison, &lt;<a href=3D"mailto:pmch2@xxxxxxxx= uk" moz-do-not-send=3D"true" class=3D"moz-txt-link-freetext">pmch2@xxxxxxxx= .uk</a>&gt; wrote:<br> </div> <blockquote class=3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div dir=3D"ltr"> <div style=3D"font-family:Calibri,Helvetica,sans-serif;= font-size:11pt;color:rgb(0,0,0)"><span style=3D"font-size:11pt;margin:0px= ;color:black;background-color:rgb(255,255,255)">Dear all,</span> <div style=3D"font-size:11pt;margin:0px;color:black;b= ackground-color:rgb(255,255,255)"><br> </div> <div style=3D"font-size:11pt;margin:0px;color:black;b= ackground-color:rgb(255,255,255)">Several colleagues have mentioned how peer review is unduly biased by the reputation of the authors/institutions. I agree that this is an important problem, but it's only fair to observe that it applies to preprints too. In a world where we don't have time to read every preprint, many people will still end up using imperfect proxies for deciding what to read, such as the reputation of the authors/institutions. In the absence of a journal's mark of approval, these imperfect proxies could grow more influential, not less influential.</div> <div style=3D"font-size:11pt;margin:0px;color:black;b= ackground-color:rgb(255,255,255)"><br> </div> <div style=3D"font-size:11pt;margin:0px;color:black;b= ackground-color:rgb(255,255,255)">Best wishes</div> <span style=3D"font-size:11pt;margin:0px;color:black;= background-color:rgb(255,255,255)">Peter</span><br> </div> <hr style=3D"display:inline-block;width:98%"> <div id=3D"m_-848478907251340195divRplyFwdMsg" dir=3D"l= tr"><font style=3D"font-size:11pt" face=3D"Calibri, sans-serif" color=3D"= #000000"><b>From:</b> AUDITORY - Research in Auditory Perception &lt;<a href=3D"mailto:AUDITO= RY@xxxxxxxx" target=3D"_blank" rel=3D"noreferrer" moz-do-not-send=3D= "true" class=3D"moz-txt-link-freetext">AUDITORY@xxxxxxxx</a>&gt; on behalf of Helia Relano Iborra &lt;<a href=3D"mai= lto:0000017f74f788f8-dmarc-request@xxxxxxxx" target=3D"_blank" rel= =3D"noreferrer" moz-do-not-send=3D"true" class=3D"moz-txt-link-freetext">= 0000017f74f788f8-dmarc-request@xxxxxxxx</a>&gt;<br> <b>Sent:</b> 06 June 2023 09:21<br> <b>To:</b> <a href=3D"mailto:AUDITORY@xxxxxxxx= CA" target=3D"_blank" rel=3D"noreferrer" moz-do-not-send=3D"true" class=3D= "moz-txt-link-freetext"> AUDITORY@xxxxxxxx</a> &lt;<a href=3D"mailt= o:AUDITORY@xxxxxxxx" target=3D"_blank" rel=3D"noreferrer" moz-do-n= ot-send=3D"true" class=3D"moz-txt-link-freetext">AUDITORY@xxxxxxxx= </a>&gt;<br> <b>Subject:</b> Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of trust</font> <div>&nbsp;</div> </div> <div link=3D"blue" vlink=3D"purple" style=3D"word-wrap:= break-word" xml:lang=3D"DA" lang=3D"DA"> <div> <p><span>Dear Brian, all,</span></p> <p><span>&nbsp;</span></p> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">Thank yo= u for a very enriching discussion. I just wanted to counter Brian=E2=80=99s last email, regardin= g the neutrality of peer review. There is extensive evidence of =E2=80=9Cstatus bias=E2=80=9D in th= e peer-review system in studies comparing single-blind vs double-blind reviews.</span> <span>E.g. Huber et al.</span> <span xml:lang=3D"EN-US" lang=3D"= EN-US"> (2022) <a href=3D"https://urldefense.com/v3/__https://www.pnas.or= g/doi/10.1073/pnas.2205779119__;!!Cn_UX_p3!hQG4VnqUSkjUxB_2-8_weCdic9HBEK= Kig8nWowxLkr_YPeIHTZKV4PBufa3nQ74AwuKvxBhaeDUhFdLu$" target=3D"_blank" re= l=3D"noreferrer" moz-do-not-send=3D"true"> https://www.pnas.org/doi/10.1073/pnas.2205779119</a> or Blank (1991) <a h= ref=3D"https://urldefense.com/v3/__https://www.jstor.org/stable/2006906__= ;!!Cn_UX_p3!hQG4VnqUSkjUxB_2-8_weCdic9HBEKKig8nWowxLkr_YPeIHTZKV4PBufa3nQ= 74AwuKvxBhaeD7Se3ou$" target=3D"_blank" rel=3D"noreferrer" moz-do-not-sen= d=3D"true"> https://www.jstor.org/stable/2006906</a>. No system (or person) is free of bias, unfortunately. I think recognizing that these biases exist and being aware of them when we are reviewing manuscripts can only make us better reviewers.</span></p> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">&nbsp;</= span></p> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">Best,</s= pan></p> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">Helia.</= span></p> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">&nbsp;</= span></p> <p style=3D"line-height:12.75pt"><span style=3D"fon= t-size:8.5pt;font-family:&quot;Arial&quot;,sans-serif" xml:lang=3D"EN-US"= lang=3D"EN-US">&nbsp;</span></p> <table style=3D"width:300.0pt" width=3D"400" cellsp= acing=3D"0" cellpadding=3D"0" border=3D"0"> <tbody> <tr> <td style=3D"width:300.0pt;padding:0cm 0cm 0c= m 0cm" width=3D"400"> <table style=3D"width:300.0pt;border-collap= se:collapse" width=3D"400" cellspacing=3D"0" cellpadding=3D"0" border=3D"= 0"> <tbody> <tr> <td style=3D"width:37.5pt;padding:0cm 0cm 0cm 0cm" width=3D"50" valign=3D= "top"> <table style=3D"width:37.5pt" width= =3D"50" cellspacing=3D"0" cellpadding=3D"0" border=3D"0"> <tbody> <tr> <td style=3D"width:37.5pt;pad= ding:3.0pt 0cm 0cm 0cm" width=3D"50" v= align=3D"top"> <p>&lt;&gt;</p> </td> </tr> </tbody> </table> </td> <td style=3D"width:262.5pt;padding:0c= m 0cm 0cm 0cm" width=3D"350" valign=3D= "top"> <table style=3D"width:262.5pt;borde= r-collapse:collapse" width=3D"350" cellspacing=3D"0" cellpadding=3D"0" bo= rder=3D"0"> <tbody> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:120= %"><b><span style=3D"font-size:12.0pt;line-height:120%;font-family:&quot;= Arial&quot;,sans-serif;color:black">Helia Rela=C3=B1o Iborra</s= pan></b></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black">Postdoc</span></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black" xml:lang=3D"EN-US" lang=3D"EN-US">Hearing Systems Section</span><= /p> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black" xml:lang=3D"EN-US" lang=3D"EN-US">Department of Health Technology</s= pan></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black"><a href=3D"mailto:heliaib@xxxxxxxx" target=3D"_blank" rel= =3D"noreferrer" moz-do-not-send=3D"true"><span style=3D"color:black">heli= aib@xxxxxxxx</span></a></span></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black">=C3=98rsteds Plads</span></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black">Building 352</span></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black">2800&nbsp;Kgs. Lyngby</span></p> </td> </tr> <tr> <td style=3D"width:262.5pt;pa= dding:0cm 0cm 0cm 0cm" width=3D"350"> <p style=3D"line-height:12.= 75pt"><span style=3D"font-size:8.5pt;font-family:&quot;Arial&quot;,sans-s= erif;color:black"><a href=3D"https://urldefense.com/v3/__https://www.dtu.= dk/english__;!!Cn_UX_p3!hQG4VnqUSkjUxB_2-8_weCdic9HBEKKig8nWowxLkr_YPeIHT= ZKV4PBufa3nQ74AwuKvxBhaeFMz9jY_$" target=3D"_blank" rel=3D"noreferrer" mo= z-do-not-send=3D"true"><span style=3D"color:black">www.dtu.dk/english</sp= an></a></span></p> </td> </tr> </tbody> </table> </td> </tr> </tbody> </table> </td> </tr> </tbody> </table> <p>&nbsp;</p> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">&nbsp;</= span></p> <div> <div style=3D"border:none;border-top:solid #e1e1e= 1 1.0pt;padding:3.0pt 0cm 0cm 0cm"> <p><b><span xml:lang=3D"EN-US" lang=3D"EN-US">F= rom:</span></b> <span xml:lang=3D"EN-US" lang=3D"EN-US"> AUDITORY - Research in Auditory Perception &lt;<a href=3D"mailto:AUDITORY@xxxxxxxx= .CA" target=3D"_blank" rel=3D"noreferrer" moz-do-not-send=3D"true" class=3D= "moz-txt-link-freetext">AUDITORY@xxxxxxxx</a>&gt; <b>On Behalf Of</b> Brian FG Katz (SU)<br> <b>Sent:</b> 6. juni 2023 09:27<br> <b>To:</b> <a href=3D"mailto:AUDITORY@xxxxxxxx= .MCGILL.CA" target=3D"_blank" rel=3D"noreferrer" moz-do-not-send=3D"true"= class=3D"moz-txt-link-freetext"> AUDITORY@xxxxxxxx</a><br> <b>Subject:</b> Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of trust</span></p= > </div> </div> <p><span xml:lang=3D"EN-US" lang=3D"EN-US">&nbsp;</= span></p> <div> <p>Dear Bob, et al,</p> </div> <div> <p>&nbsp;</p> </div> <div> <p>I feel obliged to reply to some serious statements made in recent posts. While i think there is little doubt that numerous bias elements (privileges of various sorts&quot; are present in career evolutions, recruitment committees, promotions, be them academic or corporate, I must return to the discussion to the topic at hand, in the broad sense, of the importance of peer-review.&nbsp;</p> </div> <div> <p>&nbsp;</p> </div> <div> <p>As a regular reviewer in various journals (and fields of acoustics) what is judged is the work on the page, no more and no less. No free rides are given to authors of high reputation (sometime more scrutiny), nor penalties to young unknowns or unrepresented countries (sometimes more flexibility is given). If the arguement for publication is unpersuasive, it is solely on the merit of the presentation of the work. I say it this way because again it is only what is on the page that is reviewed. The work itself may be of high standards, but a work is reviewed by what is stated, not what is intended. As an Associate Editor, the same is true. Specific knowledge of the author is really only needed to assure lack of direct conflicts of interest in selecting reviewers. I have never considered the background,&nbsp; academic or ca= reer history of an author in accepting or rejecting a manuscript. I would even go so far as to say if one considers these elements in one's reviews they should probably recuse themselves from such benevolent activities to the community.&nbsp;</p> </div> <div> <p>&nbsp;</p> </div> <div> <p>Finally, returning to the question of arXiv and preprints, where this all started, I don't think anyone came out against them on the whole, but they should be taken for what they are, and no more. They are a scientific blog or a conference proceeding. They do not hold the same value, or represent the same rigor of critique, that a journal article has passed. Thie difference is clear. However, it is only really relevant in a few circumstances: as a substantive citation in another journal article, in an academic/research career application/review, or a project proposal (a version of the previous point). If one doesn't require these elements, and that is a choice, then one isn't limited by the means one chooses to disseminate one's work. No one has critiqued the use of arxiv and the like, per se,&nbsp; but if one is competing on the qualit= y of one's work, the process of peer-review is the widely accepted passage for some semblance of quality, for which no other alternative currently exists. A review committee cannot be expected to read every article, let alone the comments section, and be required to form an opinion.&nbsp;</p> </div> <div> <p>&nbsp;</p> </div> <div> <p>This does not say the process cannot be improved, and that is also the motivation for journal quality classifications and the exclusion of some journals from being &quot;acceptable&quot; is those situations. Suc= h rapid publication and limited review journals are more akin to arXiv than a reputable journal, though with fees, and rightly so with regards to scientific scrutiny. One is free to use them for what they are, but one should not make claims that they are anything more.</p> </div> <div> <p>&nbsp;</p> </div> <div> <p>At least, that is my perspective.</p> </div> <div id=3D"m_-848478907251340195x_composer_signatur= e"> <p>--</p> <div> <p>Brian FG Katz</p> </div> <div> <p>Equipe LAM : Lutheries Acoustique Musique</p= > </div> <div> <p>Sorbonne Universit=C3=A9, CNRS, Institut =E2=88=82'Alembert</p> </div> </div> <div> <p>&nbsp;</p> </div> <div> <p>&nbsp;</p> </div> <div> <p><span style=3D"color:black">-------- Original message --------</span></p> </div> <div> <p><span style=3D"color:black">From: &quot;McMurr= ay, Bob&quot; &lt;<a href=3D"mailto:bob-mcmurray@xxxxxxxx= UIOWA.EDU" target=3D"_blank" rel=3D"noreferrer" moz-do-not-send=3D"true" = class=3D"moz-txt-link-freetext">bob-mcmurray@xxxxxxxx</a>&gt;</span></p> </div> <div> <p><span style=3D"color:black">Date: 6/6/23 06:09 (GMT+01:00)</span></p> </div> <div> <p><span style=3D"color:black">To: <a href=3D"mai= lto:AUDITORY@xxxxxxxx" target=3D"_blank" rel=3D"noreferrer" moz-do= -not-send=3D"true" class=3D"moz-txt-link-freetext"> AUDITORY@xxxxxxxx</a></span></p> </div> <div> <p><span style=3D"color:black">Subject: Re: [AUDITORY] [External] Re: [AUDITORY] arXiv web of trust</span></p> </div> <div> <p><span style=3D"color:black">&nbsp;</span></p> </div> <div> <p>Hi Colleagues</p> <div> <div> <p>&nbsp;</p> <p>I=E2=80=99ve been watching from the wings = on this discussion as I think our field is in a real point of flux with respect to scientific publishing and communication, and I don=E2=80=99t think I know what=E2=80= =99s best any more. &nbsp;&nbsp;Its been fun to watch a v= ery healthy and vigorous conversation unfold amonst my esteemed colleagues =E2=80=93 bot= h junior and senior =E2=80=93 and I=E2=80=99v= e learned a lot.</p> <p>&nbsp;</p> <p>However, Matt (and Deniz) made a very powerful point, that I felt the need to weigh in on.&nbsp; They argue that the very nature of scientific communication is pervaded by issues power, positionality and discrimination. I don=E2=80=99t think I realized this till recently (perhaps I was an Eagle in that cartoon), but they are right. It=E2=80=99s important.</p> <p>&nbsp;</p> <p>Les, I respect your point of view.&nbsp; W= e should be having these open and objective conversations and we should strive for that.&nbsp; But we also have to recognize t= hat this is an aspirational point of view.&nbsp= ; In my view, the rhetoric of science is not objective. Its persuasive.&nbsp; A scientif= ic discovery from my lab is not a fact until I convince the scientific community to believe it (or at least convince Reviewers 1,2 and 3).&nbsp; The rules of science =E2=80= =93 statistical and methodological norms, peer review, and the like -- are really designed to ensure that this persuasion is all geared to some mutually acceptable norms of objectivity.&nbsp; It often works = and there=E2=80=99s not much better.</p> <p>&nbsp;</p> <p>But fundamentally this is still a persuasive enterprise (as it should be).&nb= sp; And fundamentally, some people =E2=80=93 by= virtue of their station and background =E2=80=93 a= re going to be in a better place to persuade their colleagues than others.&nbsp; We comm= only associate these issues of discrimination and positionality with things like race, religion and gender.&nbsp; And indeed these things matter =E2=80=93 just look at the disparities among the medalists of the ASA and you can see for yourself.</p> <p>&nbsp;</p> <p>But a good friend of mine recently showed me how these kind of factors extend all throughout academia.&nbsp; Are some fields privileged?&nbsp; Are hearing scientists mo= re likely to discount a finding from a linguist or a social scientist than someone who is solidly situated in hearing science?&nbsp; What about a finding from a small clinical population (a =E2=80=9Cniche= =E2=80=9D field) or an obscure auditory phenomena vs. as opposed to a finding based on the core =E2=80=9Cmodal=E2=80=9D NH adult in a = sound proof booth?&nbsp; Are we more likely to take a finding seriously if it was generated by one of the top universities (in our field) than a second tier state university?&nbsp; = Or from a new scholar that was trained by one of the best vs. an emerging scholar who came to the field more independently?&nbsp; What about a person who is changing fields =E2=80=93 migrating, for example, from a fi= eld like cognitive science to audiology or hearing science?&nbsp; What about clinical credentialing?&nbsp; Does that help or harm= our cases?</p> <p>&nbsp;</p> <p>All of these things have nothing to do with the objective argument that is being made and the quality of the data used to support it.&nbsp; But we all must admit tha= t they do change how much credence we are likely to give a discussion or a paper (and each of us may weigh these differently).&nbsp; Sometimes these are use= ful heuristics =E2=80=93 if the methods aren=E2= =80=99t clear, but you know how a person was trained, it may be easier to trust that the experiments were done right.&nbsp; But sometimes this is just downright discriminatory, like when we discount contributions from outside what we perceive as the core field.</p> <p>&nbsp;</p> <p>But how does this impact scientific publishing?</p> <p>&nbsp;</p> <p>Matt makes the valuable point that as our field opens up to new viewpoints and new participants, the view from those people may be very different than the view from the people at the top.&nbsp; We should list= en. People do struggle to gain entry to this field.&nbsp; I certainly did when I began working in hearing science, despite my training at a very good cognitive science program.</p> <p>&nbsp;</p> <p>Peer review is part of the problem.&nbsp; = It can amplify these biases.&nbsp; And peer re= view is not designed to =E2=80=9Chelp=E2=80=9D n= ew entries =E2=80=93 its is designed to help a journal editor decide what to do with a paper. So it often serves as an impersonal barrier to entry.&nbsp; OF course, we cannot dispense = with it.&nbsp; But we should be actively explori= ng other models.&nbsp; if this new generation = of talented, thoughtful, diverse and enterprising young scholars wants to engage in novel modes of scientific communication, I=E2=80=99m happy to listen = and to contribute to these new models.</p> <p>&nbsp;</p> <p>theBob</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p> </div> </div> <p>&nbsp;</p> <div> <div> <p>On Thu, Jun 1, 2023 at 1:55=E2=80=AFPM Les Bernstein &lt;<a href=3D"mailto:lbernstein@xxxxxxxx= uchc.edu" target=3D"_blank" rel=3D"noreferrer" moz-do-not-send=3D"true" c= lass=3D"moz-txt-link-freetext">lbernstein@xxxxxxxx</a>&gt; wrote:</p> </div> <blockquote style=3D"border:none;border-left:so= lid #cccccc 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5= .0pt"> <div> <div> <p>On 5/31/2023 2:15 PM, Matthew Winn wrote:</p> </div> <blockquote style=3D"margin-top:5.0pt;margi= n-bottom:5.0pt"> <div> <p style=3D"text-align:center;backgroun= d:#d5eaff" align=3D"center"><span style=3D"font-size:12.0pt;color:red">**= * Attention: This is an external email. Use caution responding, opening attachments or clicking on links. ***</span></p> </div> <div> <div> <div> <p>There are statements in this thread that cannot go unchallenged, because they condone and perpetuate harmful ideas that need to end. Specifically:<br> 1) =E2=80=9CIf one is not a suffi= ciently confident and independent thinker such that one can express ideas, arguments, disagreements, etc. with anyone in the field, regardless of stature, then that is a weakness=E2=80=9D<br> This statement ignores the multiple power structures that affect the lives and employment of those below the =E2=80=98upper echelon=E2=80=99 in the field. Expressing an idea involves risk when your position is precarious. Adapting to and weighing that risk is a key survival strategy, not a weakness. I have a blind spot for this risk =E2=80=93 not becau= se I=E2=80=99m so great at science, but because my culture gives me unearned respect because of my demographics. For people like me (and, I will note, virtually everyone on this thread), we live in a culture that insulates us from any sense that our voice doesn=E2=80=99t belong.</p> </div> </div> </div> </blockquote> <p style=3D"margin-bottom:12.0pt"><br> <span style=3D"font-size:10.0pt;font-fami= ly:&quot;Helvetica&quot;,sans-serif">I could not disagree more.&nbsp; The suggestion that, within our field, different cultural backgrounds confer more or less ability to have productive scientific discussions with anyone, regardless of status is, as I see it, just plain nonsense.&nbsp; Expressing an idea involves risk?&nbsp; Really, in our field of auditory science?&nbsp; I can give plenty of counterexamples to such an assertion.</= span></p> <blockquote style=3D"margin-top:5.0pt;margi= n-bottom:5.0pt"> <div> <div> <div> <p><br> <br> 2) =E2=80=9Cthink about how such researchers earned such status.&n= bsp; It was not because they had friends, it was not because people liked them.&nbsp; It was because they established a track-record of contributions that the field, in general, held in very high regard.=E2=80=9D<br> This is a self-serving narrative that reflects survivorship bias and which ignores everything we know about how people act in real life. Science is done by humans, who have personal interests, biases, and who live within a culture where status is built on many layers of privilege. Every decision we make is filtered by these factors, which allow some people (like me) to accumulate a variety of advantages at every career stage, simply because of how they look, who their friends are, and where they grew up. They are more likely to have papers accepted, to be selected for podium presentations, to have a job application reviewed, to be interviewed, to be hired, to be selected as editors and reviewers, to be elected to positions of leadership, and to be given favorable treatment in the workplace. To be taken seriously. If we pretend that these advantages are ALL due to the scientific merit of one=E2=80= =99s work, we are characterizing scientists as some species entirely separate from the rest of humanity.</p> </div> </div> </div> </blockquote> <p style=3D"margin-bottom:12.0pt"><span sty= le=3D"font-size:10.0pt;font-family:&quot;Helvetica&quot;,sans-serif">Agai= n, theoretical, social drivel.&nbsp; Lloyd Jeffress, Dave Green, Neal Viemester, Barbara Bohne, and on and on.&nbsp;</sp= an></p> <blockquote style=3D"margin-top:5.0pt;margi= n-bottom:5.0pt"> <div> <div> <div> <p><br> <br> 3) =E2=80=9CStature does not coun= t. Everyone should be held to the very same standard=E2=80=9D<br> We all agree that work should not be judged on the basis of who wrote it. But importantly, the influence of stature doesn=E2= =80=99t need to be explicitly suggested in order to actually take place. Similar to the last point, the idea of equal standards and equal treatment is a convenient fiction that allows people like me to feel superior because I can attribute my success to my own hard work and merit, even though many factors that led to that success were unearned.</p> </div> </div> </div> </blockquote> <p style=3D"margin-bottom:12.0pt"><span sty= le=3D"font-size:10.0pt;font-family:&quot;Helvetica&quot;,sans-serif">Agai= n, your theoretical musing.&nbsp; Not the reality in auditory science that I have seen.</span></p> <blockquote style=3D"margin-top:5.0pt;margi= n-bottom:5.0pt"> <div> <div> <div> <p><br> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D<br> What does this have to do with preprints? The point is to consider that others have a different set of constraints, and that our definitions of merit are tailored to suit those who are already enjoying a wide variety of privileges. Consider the forces that lead authors to think that preprints are useful, and also whether you are facing the same expectations and constraints that they are. Numerous people have pointed at the apparent generational divide on this issue - let's figure out why. Graduate admissions and fellowship review increasingly expect a publication record that far exceeds anything that would have been expected of the reviewers when they were at that same career stage. For various reasons, the timeline of publication is increasingly long. Exacerbating this, it is no longer enough to simply conduct a good study; one must also curate a data management and sharing plan that includes open-access data and documented code. One must learn and conduct the latest statistical techniques that their advisors never needed to learn, and sift through a much broader set of literature that includes a lot of garbage. To compete for stable employment, younger scholars need an internet presence and must learn to incorporate inclusive language in their writing, even if that were not part of their training. They need to express how their work contributes to the reduction of harm in society, despite being advised by some of the people who are doing the harm.</p> </div> </div> </div> </blockquote> <p style=3D"margin-bottom:12.0pt"><br> <span style=3D"font-size:10.0pt;font-fami= ly:&quot;Helvetica&quot;,sans-serif">None of this, much of which I find to be mere unjustified assertion, is an argument for shifting the weight of dissemination of work toward non-refereed open access.&nbsp; By the = way, when was it the case that a solid knowledge of statistical techniques was unnecessary?&nbsp; Hey, you don't h= ave to wire together analog equipment to generate your signals!</span></p> <blockquote style=3D"margin-top:5.0pt;margi= n-bottom:5.0pt"> <div> <div> <div> <p><br> Preprints are not a magical solution that can eliminate the multiple barriers that I described above. But they have tangible value, and reflect adaptation to a changing academic landscape, rather than reflecting some loss of =E2=80=9Cstandards=E2=80=9D that = are designed to protect those already at the top, and which were established under an entirely different system of constraints.</p> </div> <div> <p>&nbsp;<br> Preprints help address the needs for 1) visibility and 2) quicker feedback on your work from a wider variety of scholars who might not have been invited to review, simply because they were not in the network of the associate editor. These factors are often yoked together; the channels that spread awareness of a preprint (like Twitter) might also be the same channels that generate discussion that becomes useful feedback. The tendency (or need) to use these dissemination channels probably reinforces the generational divide on this thread. I assure you that the comments I've received from people enthusiastic enough to read a preprint have had meaningful influence and value. And those comments can come from a wider variety of people whose opinions have been historically discounted. Experienced reviewers will always have a place in our scientific discourse, but to discount the benefit and potential of preprints is to be willfully detached from our current reality.</p> </div> </div> </div> </blockquote> <p style=3D"margin-bottom:12.0pt"><span sty= le=3D"font-size:10.0pt;font-family:&quot;Helvetica&quot;,sans-serif"><br> I never said one should not use pre-prints for whatever benefit they can confer.</span></p> <blockquote style=3D"margin-top:5.0pt;margi= n-bottom:5.0pt"> <div> <div> <div> <p><br> Matt</p> </div> </div> </div> </blockquote> <p style=3D"margin-bottom:12.0pt">&nbsp;</p= > <div> <p>--</p> <div> <div> <p><b>Leslie R. Bernstein, Ph.D. |</b= > Professor Emeritus</p> <div> <div> <div> <div> <p>Depts. of Neuroscience and Surgery (Otolaryngology) | UConn School of Medicine<br> 263 Farmington Avenue, Farmington, CT 06030-3401<b= r> Office: 860.679.4622 | Fax: 860.679.2495<br> <br> &lt;&gt;</p> </div> </div> </div> </div> </div> </div> </div> </div> </blockquote> </div> <p><br clear=3D"all"> </p> <div> <p>&nbsp;</p> </div> <p><span>--</span></p> <div> <div> <div> <div> <p>Matthew Winn, AuD, PhD</p> <div> <p>Associate Professor</p> </div> <div> <p>Speech-Language-Hearing Sciences</p> </div> <div> <p>University of Minnesota</p> </div> </div> </div> </div> </div> </div> </div> </div> </div> </blockquote> </div> </blockquote> </div> </div> </blockquote> <br> <br> <div class=3D"moz-signature">-- <br> =20 <title></title> <div class=3D"moz-signature"> <div class=3D"moz-signature"><b><span style=3D"font-size:10.0pt;f= ont-family:&quot;Arial&quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#002048&quot;">Leslie R. Bernstein, Ph.D. </span>= </b><b><span style=3D"font-size:10.0pt;font-family:&quot;Arial&quot;,sans= -serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;">| </span></b><span style=3D"font-s= ize:10.0pt;font-family:&quot;Arial&quot;,sans-serif;mso-fareast-font-fami= ly:&quot;Times New Roman \;color\:\#585858&quot;">Professor Emeritus</span><= span style=3D"mso-fareast-font-family: &quot;Times New Roman&quot;"><o:p>= </o:p></span><span style=3D"font-size:10.0pt;font-family:&quot;Arial&quot= ;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;"></span><br> <div class=3D"moz-signature"> <div class=3D"moz-signature"> <div class=3D"moz-signature"><span style=3D"font-size:10.0p= t;font-family:&quot;Arial&quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;"></span> <div class=3D"moz-signature"><span style=3D"font-size:10.= 0pt;font-family:&quot;Arial&quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;"> Depts. of Neuroscience and Surgery (Otolaryngology) | UConn School of Medicine </span><br> <span style=3D"font-size:10.0pt;font-family:&quot;Arial= &quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;"></span><span style=3D"font-s= ize:10.0pt;font-family:&quot;Arial&quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;">263 Farmington Avenue, Farmington, CT 06030-3401</span><br> <span style=3D"font-size:10.0pt;font-family:&quot;Arial= &quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;"></span><span style=3D"font-s= ize:10.0pt;font-family:&quot;Arial&quot;,sans-serif; mso-fareast-font-family:&quot;Times New Roman \;color\:\#585858&quot;">Office: 860.679.4622 | Fax: 860.679.2495<br> <br> <img moz-do-not-send=3D"false" src=3D"cid:part1.obmz6= Nhm.x09WzG4O@xxxxxxxx" alt=3D"" class=3D"" width=3D"125" height=3D"48"><b= r> </span> </div> </div> </div> </div> </div> </div> </div> </body> </html> --------------vaFv16ojRxGvXXkPkNiF0rxY Content-Type: image/png; name="image001.png" Content-Disposition: inline; filename="image001.png" Content-ID: <part1.obmz6Nhm.x09WzG4O@xxxxxxxx> Content-Transfer-Encoding: base64 iVBORw0KGgoAAAANSUhEUgAAAH0AAAAwCAMAAAALmIWlAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJ bWFnZVJlYWR5ccllPAAAADNQTFRFKzVYHCZM4eLn8PHzpKi30dTbaG+IlZqrs7fDWWB8O0Nkd32U wsXPSlJwhoufDRhA////A68jmAAAABF0Uk5T/////////////////////wAlrZliAAACYklEQVR4 2uzY22KDIAwAUC7e6gjw/187gUC4OetaupflaTXKWSuBKNMuJptC+QMCP20auPHBQCubBWU46K24 uB7NfZ58ZqaMP8D8AEBHtT/goXnB8WPwBf8r1WYUXWxUOZobHcJXIMcfONclmE4s0lrRzYBIOjvT jX5WV6YbP2ZQJ6TWjfiAbuYzHW7p+xpuolQrP83sjQ5nupnu6LqaJ92MbnSznulcfkBHpNXNY6y+ c0JKnWX1eFeflQt5qcNESKnrQMrf6LSAXeiWkEoXdOU4nZBKxzPnoTohtW5ZZyK8W09Io6tYjyP1 iDS6XbAeh815S0irS6zHUfXuB0Ok1S3W41AdEWh1/Nb7UD1bWytd0LY4ThdnerYbBJ1taT5XBmy4 J8mNnWagp5fbba6HeiTdneK6vNgoFj0EhyO4eSZT6AlpdNXoNzqYi94GbIU0eqhHp3d5drRf4heZ Uo9Iq8vYptup6VB37H6m/W6m0hFpdaxH3/yK9cHpVq5Zy59n2GMV/QxPGdV9NElPE9njyOozsfWW Kq6j7bLuw97KPBnM/mX86//6n+tH/yLKP7AUXcyd80Lx53WnspB47ty5qKND1gLockfIFzHR7srp Q7X0+6GgHPNFXedPyaN1CPFli71z+ZBeTxbcI2RXxwOQj/lW/Ui610Z6gA4a32WRrssXYbO76V/Z y6FLnZVj/qCnqGcdZE1DeFKcntWrMV/RZXCh7B/fpF/+8tQQx6J74y9/Oeuyrm75+Jyf8oKWH9CL 1SYNJtJ91HTOAD2fdjPN9UcsumwmDNYXqvPtOLa9pH8LMACnoV0siZAyOAAAAABJRU5ErkJggg== --------------vaFv16ojRxGvXXkPkNiF0rxY-- --------------eXkqIu2Qy0cV30rTRraY0zgw--


This message came from the mail archive
src/postings/2023/
maintained by:
DAn Ellis <dpwe@ee.columbia.edu>
Electrical Engineering Dept., Columbia University