Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications

With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Th...

Full description

Saved in:
Bibliographic Details
Main Authors: Gan, Woon-Seng, Ooi, Kenneth, Kang, Jian, Feng, Jing, Hong, Joo Young, Lam, Bhan, Ong, Zhen-Ting, Tan, Sze-Tiong
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2018
Subjects:
Online Access:https://hdl.handle.net/10356/88359
http://hdl.handle.net/10220/47028
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-88359
record_format dspace
spelling sg-ntu-dr.10356-883592020-03-07T14:02:35Z Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications Gan, Woon-Seng Ooi, Kenneth Kang, Jian Feng, Jing Hong, Joo Young Lam, Bhan Ong, Zhen-Ting Tan, Sze-Tiong School of Electrical and Electronic Engineering Digital Signal Processing Lab Acoustic Reproduction Soundscape DRNTU::Engineering::Electrical and electronic engineering With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Through subjective evaluations with 30 participants, the same participant evaluated four outdoor in situ locations vis-à-vis its corresponding audio-visual recording in VR on a separate day. A total of three spatial audio reproduction methods were assessed in VR, and they were all down-mixed from the first-order ambisonics (FOA) recordings to headphone-based FOA-static binaural, FOA-tracked binaural; and FOA 2-dimensional (2D) octagonal speaker array. The participants evaluated the acoustic environment in terms of the overall soundscape quality and perceived spatial qualities at each location. Regarding overall soundscape quality, there were no significant differences in evaluating the sound-source dominance and affective soundscape qualities between in situ and all VR methods. However, significant differences were found in the perceived spatial qualities between three reproduction methods and in situ. Among the source-related spatial attributes, the perceived distance of the dominating sounds was farther in the virtual than in the in situ evaluations. In the localization of sound sources, both the FOA-tracked binaural and the FOA-2D speaker array exhibited higher spatial acoustic fidelity than FOA-static binaural. Regarding the environment-related spatial quality attributes, the 2D speaker array reproduction was perceived as more immersive and realistic than other reproduction methods. Overall, the FOA-tracked binaural appears to exhibit sufficient fidelity for cinematic VR evaluation of soundscapes. NRF (Natl Research Foundation, S’pore) Accepted version 2018-12-18T01:45:16Z 2019-12-06T17:01:29Z 2018-12-18T01:45:16Z 2019-12-06T17:01:29Z 2019 2018 Journal Article Hong, J. Y., Lam, B., Ong, Z.-T., Ooi, K., Gan, W.-S., Kang, J., . . . Tan, S.-T. (2018). Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications. Building and Environment, 149, 1-14. doi:10.1016/j.buildenv.2018.12.004 0360-1323 https://hdl.handle.net/10356/88359 http://hdl.handle.net/10220/47028 10.1016/j.buildenv.2018.12.004 209165 en Building and Environment © 2018 Elsevier. This is the author created version of a work that has been peer reviewed and accepted for publication by Building and Environment, Elsevier. It incorporates referee’s comments but changes resulting from the publishing process, such as copyediting, structural formatting, may not be reflected in this document. The published version is available at: [http://dx.doi.org/10.1016/j.buildenv.2018.12.004]. 42 p. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic Acoustic Reproduction
Soundscape
DRNTU::Engineering::Electrical and electronic engineering
spellingShingle Acoustic Reproduction
Soundscape
DRNTU::Engineering::Electrical and electronic engineering
Gan, Woon-Seng
Ooi, Kenneth
Kang, Jian
Feng, Jing
Hong, Joo Young
Lam, Bhan
Ong, Zhen-Ting
Tan, Sze-Tiong
Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
description With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Through subjective evaluations with 30 participants, the same participant evaluated four outdoor in situ locations vis-à-vis its corresponding audio-visual recording in VR on a separate day. A total of three spatial audio reproduction methods were assessed in VR, and they were all down-mixed from the first-order ambisonics (FOA) recordings to headphone-based FOA-static binaural, FOA-tracked binaural; and FOA 2-dimensional (2D) octagonal speaker array. The participants evaluated the acoustic environment in terms of the overall soundscape quality and perceived spatial qualities at each location. Regarding overall soundscape quality, there were no significant differences in evaluating the sound-source dominance and affective soundscape qualities between in situ and all VR methods. However, significant differences were found in the perceived spatial qualities between three reproduction methods and in situ. Among the source-related spatial attributes, the perceived distance of the dominating sounds was farther in the virtual than in the in situ evaluations. In the localization of sound sources, both the FOA-tracked binaural and the FOA-2D speaker array exhibited higher spatial acoustic fidelity than FOA-static binaural. Regarding the environment-related spatial quality attributes, the 2D speaker array reproduction was perceived as more immersive and realistic than other reproduction methods. Overall, the FOA-tracked binaural appears to exhibit sufficient fidelity for cinematic VR evaluation of soundscapes.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Gan, Woon-Seng
Ooi, Kenneth
Kang, Jian
Feng, Jing
Hong, Joo Young
Lam, Bhan
Ong, Zhen-Ting
Tan, Sze-Tiong
format Article
author Gan, Woon-Seng
Ooi, Kenneth
Kang, Jian
Feng, Jing
Hong, Joo Young
Lam, Bhan
Ong, Zhen-Ting
Tan, Sze-Tiong
author_sort Gan, Woon-Seng
title Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
title_short Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
title_full Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
title_fullStr Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
title_full_unstemmed Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
title_sort quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
publishDate 2018
url https://hdl.handle.net/10356/88359
http://hdl.handle.net/10220/47028
_version_ 1681049884814213120