Real-time 3D sound system with head-tracking

• Main Author: Choong, Simin Evangeline
• Other Authors: Gan Woon Seng
• Format: Final Year Project
• Language: English
• Published: 2018
• Subjects: DRNTU::Engineering::Electrical and electronic engineering::Computer hardware, software and systems
• Online Access: http://hdl.handle.net/10356/75387
• Institution: Nanyang Technological University

In Augmented Reality (AR) applications, not only the visuals are important, the audio must sound realistic and captivating. An Augmented Reality Audio headset (ARA) can be used to deliver the audio to the user. The audio comprises of real world sounds and virtual sounds. As closed headphones are used in this project, external audio must be recorded and playback to the user over the headphones. The playback signal must strive to be acoustically transparent. The focus of this project is to implement an ARA headset to record the external sounds and capture the HRTF of the user. Digital components are used so that in future works signal processing can be applied to the captured signal. This project involves the knowledge of the hardware components like the micro-controller, the digital microphones and the specific type of connectors suitable for this implementation. The micro-controller, Teensy, was programmed with the aid of the Audio System Design Tool which appears as a USB sound device so that the computer can record and store the audio. Constant adjustments to the prototype were made to keep it as compact as possible. Software audio recording applications were also explored to execute simultaneous multi-channel recording. Further research using this project as a basis could expand the potential of a typical ARA headset, providing users with a more immersive experience.