[AUDITORY] MUSHRA test with open reference; and then without open reference

[#ARIJIT BISWAS# <000003292f44871c-dmarc-request@xxxxxxxxxxxxxxx>]

Dear all:

Is there any research on how subjective ratings in a MUSHRA test might be affected if the same systems (i.e., hidden reference, anchors, codecs under test) are re-evaluated without the ability to compare them against an open reference?

If no such studies/papers exist, can we make any educated guesses about the potential outcomes?

I imagine that, in the absence of a reference, the task for the subjects would become more difficult. 

Any other guesses? 

Thank you.

Best regards,

Arijit

**Disclaimer** The sender of this email does not represent Nanyang Technological University and this email does not express the views or opinions of the University.