Autonomous soundscape augmentation with multimodal fusion of visual and participant-linked inputs

• Main Authors: Ooi, Kenneth, Watcharasupat, Karn, Lam, Bhan, Ong, Zhen-Ting, Gan, Woon-Seng
• Other Authors: School of Electrical and Electronic Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2023
• Subjects: Engineering::Electrical and electronic engineering; Social sciences::Psychology::Affection and emotion; Auditory Masking; Neural Attention; Multimodal Fusion; Probabilistic Loss; Deep Learning
• Online Access: https://hdl.handle.net/10356/165017
• Institution: Nanyang Technological University

Autonomous soundscape augmentation systems typically use trained models to pick optimal maskers to effect a desired perceptual change. While acoustic information is paramount to such systems, contextual information, including participant demographics and the visual environment, also influences acous...