Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications
With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Th...
Saved in:
Main Authors: | , , , , , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2018
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/88359 http://hdl.handle.net/10220/47028 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-88359 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-883592020-03-07T14:02:35Z Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications Gan, Woon-Seng Ooi, Kenneth Kang, Jian Feng, Jing Hong, Joo Young Lam, Bhan Ong, Zhen-Ting Tan, Sze-Tiong School of Electrical and Electronic Engineering Digital Signal Processing Lab Acoustic Reproduction Soundscape DRNTU::Engineering::Electrical and electronic engineering With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Through subjective evaluations with 30 participants, the same participant evaluated four outdoor in situ locations vis-à-vis its corresponding audio-visual recording in VR on a separate day. A total of three spatial audio reproduction methods were assessed in VR, and they were all down-mixed from the first-order ambisonics (FOA) recordings to headphone-based FOA-static binaural, FOA-tracked binaural; and FOA 2-dimensional (2D) octagonal speaker array. The participants evaluated the acoustic environment in terms of the overall soundscape quality and perceived spatial qualities at each location. Regarding overall soundscape quality, there were no significant differences in evaluating the sound-source dominance and affective soundscape qualities between in situ and all VR methods. However, significant differences were found in the perceived spatial qualities between three reproduction methods and in situ. Among the source-related spatial attributes, the perceived distance of the dominating sounds was farther in the virtual than in the in situ evaluations. In the localization of sound sources, both the FOA-tracked binaural and the FOA-2D speaker array exhibited higher spatial acoustic fidelity than FOA-static binaural. Regarding the environment-related spatial quality attributes, the 2D speaker array reproduction was perceived as more immersive and realistic than other reproduction methods. Overall, the FOA-tracked binaural appears to exhibit sufficient fidelity for cinematic VR evaluation of soundscapes. NRF (Natl Research Foundation, S’pore) Accepted version 2018-12-18T01:45:16Z 2019-12-06T17:01:29Z 2018-12-18T01:45:16Z 2019-12-06T17:01:29Z 2019 2018 Journal Article Hong, J. Y., Lam, B., Ong, Z.-T., Ooi, K., Gan, W.-S., Kang, J., . . . Tan, S.-T. (2018). Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications. Building and Environment, 149, 1-14. doi:10.1016/j.buildenv.2018.12.004 0360-1323 https://hdl.handle.net/10356/88359 http://hdl.handle.net/10220/47028 10.1016/j.buildenv.2018.12.004 209165 en Building and Environment © 2018 Elsevier. This is the author created version of a work that has been peer reviewed and accepted for publication by Building and Environment, Elsevier. It incorporates referee’s comments but changes resulting from the publishing process, such as copyediting, structural formatting, may not be reflected in this document. The published version is available at: [http://dx.doi.org/10.1016/j.buildenv.2018.12.004]. 42 p. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
country |
Singapore |
collection |
DR-NTU |
language |
English |
topic |
Acoustic Reproduction Soundscape DRNTU::Engineering::Electrical and electronic engineering |
spellingShingle |
Acoustic Reproduction Soundscape DRNTU::Engineering::Electrical and electronic engineering Gan, Woon-Seng Ooi, Kenneth Kang, Jian Feng, Jing Hong, Joo Young Lam, Bhan Ong, Zhen-Ting Tan, Sze-Tiong Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
description |
With the advent of virtual reality (VR) technology, spatial audio has been increasingly adopted to evaluate the acoustic environment in soundscape research. It is therefore imperative to assess the quality of commonly used spatial audio reproduction methods to determine their ecological validity. Through subjective evaluations with 30 participants, the same participant evaluated four outdoor in situ locations vis-à-vis its corresponding audio-visual recording in VR on a separate day. A total of three spatial audio reproduction methods were assessed in VR, and they were all down-mixed from the first-order ambisonics (FOA) recordings to headphone-based FOA-static binaural, FOA-tracked binaural; and FOA 2-dimensional (2D) octagonal speaker array. The participants evaluated the acoustic environment in terms of the overall soundscape quality and perceived spatial qualities at each location. Regarding overall soundscape quality, there were no significant differences in evaluating the sound-source dominance and affective soundscape qualities between in situ and all VR methods. However, significant differences were found in the perceived spatial qualities between three reproduction methods and in situ. Among the source-related spatial attributes, the perceived distance of the dominating sounds was farther in the virtual than in the in situ evaluations. In the localization of sound sources, both the FOA-tracked binaural and the FOA-2D speaker array exhibited higher spatial acoustic fidelity than FOA-static binaural. Regarding the environment-related spatial quality attributes, the 2D speaker array reproduction was perceived as more immersive and realistic than other reproduction methods. Overall, the FOA-tracked binaural appears to exhibit sufficient fidelity for cinematic VR evaluation of soundscapes. |
author2 |
School of Electrical and Electronic Engineering |
author_facet |
School of Electrical and Electronic Engineering Gan, Woon-Seng Ooi, Kenneth Kang, Jian Feng, Jing Hong, Joo Young Lam, Bhan Ong, Zhen-Ting Tan, Sze-Tiong |
format |
Article |
author |
Gan, Woon-Seng Ooi, Kenneth Kang, Jian Feng, Jing Hong, Joo Young Lam, Bhan Ong, Zhen-Ting Tan, Sze-Tiong |
author_sort |
Gan, Woon-Seng |
title |
Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
title_short |
Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
title_full |
Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
title_fullStr |
Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
title_full_unstemmed |
Quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
title_sort |
quality assessment of acoustic environment reproduction methods for cinematic virtual reality in soundscape applications |
publishDate |
2018 |
url |
https://hdl.handle.net/10356/88359 http://hdl.handle.net/10220/47028 |
_version_ |
1681049884814213120 |