{"id":5755,"date":"2016-06-29T13:30:35","date_gmt":"2016-06-29T20:30:35","guid":{"rendered":"http:\/\/www.realhd-audio.com\/?p=5755"},"modified":"2016-06-29T13:30:45","modified_gmt":"2016-06-29T20:30:45","slug":"perceptual-evaluation-of-hra-study-proves-nothing","status":"publish","type":"post","link":"https:\/\/www.realhd-audio.com\/?p=5755","title":{"rendered":"Perceptual Evaluation of HRA Study Proves Nothing!"},"content":{"rendered":"<p>There is small but noticeable buzz circulating among audiophile sites, FB pages of prominent audio experts, and even mainstream websites stating without reservation that high-resolution audio has been proved to be perceptible. I&#8217;ve read no fewer than 6 headlines pronouncing things like, &#8220;Hi-Res Passes Key Test&#8221; (CEOUTLOOK.COM), &#8220;It&#8217;s Official: People Can Hear High-Res&#8221; (Audiostream), and &#8220;HD audio is perceptibley [sic] better than CDs&#8221;. Robert Stuart, the man behind MQA and a staunch supporter of high-resolution audio posted &#8220;This is a landmark day for audio&#8221;, on his FB page yesterday.<\/p>\n<p>These posts and articles spring from a peer reviewed AES (Audio Engineering Society) paper by Dr. Josh Reiss of Queen Mary University of London titled, &#8220;A Meta-Analysis of High Resolution Audio Perceptual Evaluation&#8221;. He wrote to a number of parties \u2014 including me \u2014 yesterday with the article attached. Dr. Reiss didn&#8217;t do a study to arrive at his conclusion that his study found &#8220;high resolution audio has a <strong>small<\/strong> but important advantage in its quality of reproduction over standard audio content&#8221;. He did a meta study of previous high-resolution audio studies. Here&#8217;s the abstract from his paper.<\/p>\n<p><em>&#8220;There is considerable debate over the benefits of recording and rendering high resolution audio, i.e., systems and formats that are capable of rendering beyond CD quality audio. We undertook a systematic review and meta-analysis to assess the ability of test subjects to perceive a difference between high resolution and standard, 16 bit, 44.1 or 48 kHz audio. All 18 published experiments for which sufficient data could be obtained were included, providing a meta-analysis involving over 400 participants in over 12,500 trials. Results showed a small but statistically significant ability of test subjects to discriminate high resolution content, and this effect increased dramatically when test subjects received extensive training. This result was verified by a sensitivity analysis exploring different choices for the chosen studies and different analysis approaches. Potential biases in studies, effect of test methodology, experimental design, and choice of stimuli were also investigated. The overall conclusion is that the perceived fidelity of an audio recording and playback chain can be affected by operating beyond conventional levels.&#8221;<\/em><\/p>\n<p>As a strong advocate for high-resolution audio\/music, I&#8217;m encouraged by his meta analysis of the existing literature (at least the 18 studies that he included in the paper&#8230;including the infamous Meyer and Moran AES paper). But as we all know, the devil is in the details. I found the paper lacking for a number of reasons&#8230;starting with the definition of high-resolution audio.<\/p>\n<p>The opening sentence gets straight to the most important issue associated with high-resolution audio\/music. The paper states, &#8220;High resolution audio may be loosely defined as those systems and formats that are capable of rendering beyond standard quality audio, i.e., more than 16 bits, and\/or more than 44.1 or 48 kHz sample rate, as used in Compact Disc (CD) or &#8216;ordinary&#8217; Digital Video Disc (DVD) quality audio.&#8221;<\/p>\n<p>Reading carefully, Dr. Reiss establishes &#8220;standard quality audio&#8221; as PCM digital audio with specifications of more than 48\/44.1 kHz sampling rates and 16-bits. Already, we have a disconnect. The CTA\/CEA Audio Board, major record labels, DEG, and NARAS organizations don&#8217;t endorse this definition. I fought long and hard to get the CEA board to move their definition above CD specifications as the baseline for high-resolution audio. The result was I got kicked off the board. Dr. Reiss&#8217; definition does nothing to help solidify the &#8220;looseness&#8221;. I would suspect that a paper of this magnitude would have to have a rigorous definition in order to report any valid results. Did the studies that he examined use 48 kHz\/20-bit PCM audio or something higher? 48\/20 is high-resolution audio in the minds of the previously mentioned organizations.<\/p>\n<p>One of my biggest complaints is the focus on the &#8220;rendering&#8221; or delivery side of the audio production chain. This completely ignores the &#8220;provenance&#8221; of the recording itself. This is the trap that Meyer and Moran fell into and is what makes their AES paper so utterly useless (but it has been used by those opposing HRA for almost ten years!). The content \u2014 the recordings used in any of the studies \u2014 has to actually contain ultrasonic frequencies and possess dynamic range higher than a standard CD. Although the paper specifically states that it didn&#8217;t analyze the papers for perceptible differences associated with greater bit depths, I believe the move to greater dynamics is more likely to be perceptible than ultrasonic frequencies.<\/p>\n<p>I am familiar with many of the 18 studies that Dr. Reiss analyzed and know that with the exception of the Meyer and Moran paper, most of the recordings used were not commercial high-resolution audio recordings. Some of the best studies made their own recordings using high-resolution equipment and took great care to ensure that ultrasonic frequencies were present. It was necessary to make new recordings because there aren&#8217;t very many commercially available. <\/p>\n<p>The paper acknowledges that &#8220;jazz and classical&#8221; music was generally used&#8230;not rock, folk, pop, or country music. Dr. Reiss said, &#8220;The studies that most showed an effect mainly used jazz and classical music, but this wasn\u2019t exclusive&#8221;. So we have another disconnect. The headlines are cheering in support of the paper and &#8220;proof&#8221; of high-resolution audio&#8217;s perceptibility for a very narrow category of music while the industry (both hardware and software) continues to promote and sell recordings that no one would be able to distinguish from their standard-resolution CD versions and a high-resolution transfer into 96 kHz\/24-bits.<\/p>\n<p>Sometimes it&#8217;s the stuff that isn&#8217;t featured that is the stuff that matters most. The provenance of the &#8220;chosen stimuli&#8221; (the recordings that were actually played for the subjects) is the most important thing\u2026and it doesn&#8217;t get much play in the AES paper.<\/p>\n<p>I applaud Dr. Reiss for his important work. He rightly describes the kinds of things that need to done during another study into the merits of high-resolution audio. I would love to be involved in a rigorous study, but the media and many supporters have already proclaimed the myth of high-res audio, as it currently exists, as fact.<\/p>\n<p>You can download the paper from the AES Journal site: <a href=\"http:\/\/www.aes.org\/e-lib\/browse.cfm?elib=18296\">Journal of the AES<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>There is small but noticeable buzz circulating among audiophile sites, FB pages of prominent audio experts, and even mainstream websites<\/p>\n","protected":false},"author":2,"featured_media":5756,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"colormag_page_container_layout":"default_layout","colormag_page_sidebar_layout":"default_layout","_exactmetrics_skip_tracking":false,"footnotes":""},"categories":[45,12],"tags":[97,657,1106,50,40,172,1107,1032,70,640,1092,26,639,1043,980,1061,42,298,251,645,638,637,227,643,169,1101,1026,1027,150,347,27,116,659],"class_list":["post-5755","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-dr_aixs_posts","category-news","tag-5-1-surround","tag-advanced-resolution","tag-aes-paper","tag-aix-records","tag-analog-vs-digital","tag-audio-resolution","tag-dr-josh-reiss","tag-dvd_audio","tag-hd-downloads","tag-hd-music","tag-hd-vinyl","tag-hd-audio","tag-hi-res-audio","tag-hi-res","tag-hi-res-music","tag-hi-res-sound","tag-high-resolution-audio","tag-high-res-music","tag-high-resolution","tag-high-resolution-audio-experience","tag-hires-audio","tag-hires-music","tag-hra","tag-hra-listening-experience","tag-mark-waldrep","tag-master-class","tag-music-and-audio","tag-music-and-audio-a-user-guide-to-better-sound","tag-pcm","tag-spectragram","tag-spectragraphs","tag-surround-music","tag-uhd-audio"],"_links":{"self":[{"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/posts\/5755","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5755"}],"version-history":[{"count":1,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/posts\/5755\/revisions"}],"predecessor-version":[{"id":5757,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/posts\/5755\/revisions\/5757"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=\/wp\/v2\/media\/5756"}],"wp:attachment":[{"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5755"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5755"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.realhd-audio.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5755"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}