Validation of binaural recordings with head tracking for use in soundscape evaluation

• Main Authors: Ooi, Kenneth, Hong, Joo-Young, Lam, Bhan, Ong, Zhen Ting, Gan, Woon-Seng
• Other Authors: School of Electrical and Electronic Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2018
• Subjects: Virtual Reality; Soundscape
• Online Access: https://hdl.handle.net/10356/88176; http://hdl.handle.net/10220/44567
• Institution: Nanyang Technological University

Given that sounds in real-life environments and soundscapes possess direction and distance cues, it is essential to replicate these cues in virtual reality (VR) simulations used for soundscape evaluation, to ensure that the results obtained have high ecological validity. One way to replicate the desired direction and distance cues of environmental sound sources in VR simulations is to use binaural recordings coupled with head tracking for playback, instead of regular binaural or stereo recordings. The effect of using binaural recordings coupled with head tracking in VR simulations for soundscape evaluations is thus investigated. Subjects were asked to evaluate soundscapes of in-situ locations. Subsequently, they were presented with VR reproductions of the same locations in a controlled laboratory environment. The reproductions used actual audio and video captured from the in-situ location, differing only in the type of audio used for playback. The subjects were asked to evaluate the VR soundscapes experienced using the different reproduction methods in a blind test. The validation of binaural recordings with head tracking for soundscape evaluation is based on the similarity of responses as compared to the in-situ locations, as well as the quality and immersiveness experienced by the subjects.