Multipurpose microphone array using Raspberry Pi and MATRIX Creator
Microphone arrays have become increasingly popular due to their usefulness in a variety of speech related applications. A lot of studies have been conducted on microphone arrays, with commercial products such as Amazon Echo enjoying widespread usage. However, existing commercial microphone array...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
Nanyang Technological University
2020
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/144643 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-144643 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1446432020-11-17T01:48:23Z Multipurpose microphone array using Raspberry Pi and MATRIX Creator Toh, Darren Ting Yu Chng Eng Siong School of Computer Science and Engineering ASESChng@ntu.edu.sg Engineering::Computer science and engineering::Computer applications::Computer-aided engineering Engineering::Computer science and engineering::Hardware::Input/output and data communications Microphone arrays have become increasingly popular due to their usefulness in a variety of speech related applications. A lot of studies have been conducted on microphone arrays, with commercial products such as Amazon Echo enjoying widespread usage. However, existing commercial microphone array systems are either not easily customizable, difficult to deploy or too costly to be used in microphone array research and development. Thus, this project aims to develop a microphone array system that is both overcomes these issues while still being robust enough to handle heavy usage. This project uses MATRIX Creator alongside Raspberry Pi as the hardware of choice due to their ease of deployment, customization, and their relatively small size. A mobile application was developed in tandem with this system to provide a wireless architecture. WiFi tethering is used to form an ad-hoc network of any number of microphone array devices that can operate synchronously for real world applications and provides a method to upload saved data to a cloud server via cellular network. To ensure that the system is robust enough to handle heavy usage, wake word detection is used to conserve computational power and power consumption. The system also introduces Voice Activity Detection (VAD) to only save voiced data and discard the remaining data to conserve memory storage. The battery-life of the system can last up to 100 hours in passive-listening mode and up to 30 hours of active recording usage which is sufficient for practical applications. Audio samples were tested to ensure the best sample accuracy between devices and the results showed a sample deviation of around 30 samples, showing a large improvement over the non-synchronized version which has a sample deviation of around 500 samples. Overall, the developed system has met the objectives of being easy to customize and deploy while still meeting real-world use case requirements. Therefore, this project could potentially bridge the gap between developers and end-users while helping to facilitate future research and development on microphone arrays. Bachelor of Engineering (Computer Science) 2020-11-17T01:35:57Z 2020-11-17T01:35:57Z 2020 Final Year Project (FYP) https://hdl.handle.net/10356/144643 en application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering::Computer applications::Computer-aided engineering Engineering::Computer science and engineering::Hardware::Input/output and data communications |
spellingShingle |
Engineering::Computer science and engineering::Computer applications::Computer-aided engineering Engineering::Computer science and engineering::Hardware::Input/output and data communications Toh, Darren Ting Yu Multipurpose microphone array using Raspberry Pi and MATRIX Creator |
description |
Microphone arrays have become increasingly popular due to their usefulness in a variety of speech related applications. A lot of studies have been conducted on microphone arrays, with commercial products such as Amazon Echo enjoying widespread usage.
However, existing commercial microphone array systems are either not easily customizable, difficult to deploy or too costly to be used in microphone array research and development. Thus, this project aims to develop a microphone array system that is both overcomes these issues while still being robust enough to handle heavy usage.
This project uses MATRIX Creator alongside Raspberry Pi as the hardware of choice due to their ease of deployment, customization, and their relatively small size. A mobile application was developed in tandem with this system to provide a wireless architecture. WiFi tethering is used to form an ad-hoc network of any number of microphone array devices that can operate synchronously for real world applications and provides a method to upload saved data to a cloud server via cellular network.
To ensure that the system is robust enough to handle heavy usage, wake word detection is used to conserve computational power and power consumption. The system also introduces Voice Activity Detection (VAD) to only save voiced data and discard the remaining data to conserve memory storage.
The battery-life of the system can last up to 100 hours in passive-listening mode and up to 30 hours of active recording usage which is sufficient for practical applications.
Audio samples were tested to ensure the best sample accuracy between devices and the results showed a sample deviation of around 30 samples, showing a large improvement over the non-synchronized version which has a sample deviation of around 500 samples.
Overall, the developed system has met the objectives of being easy to customize and deploy while still meeting real-world use case requirements. Therefore, this project could potentially bridge the gap between developers and end-users while helping to facilitate future research and development on microphone arrays. |
author2 |
Chng Eng Siong |
author_facet |
Chng Eng Siong Toh, Darren Ting Yu |
format |
Final Year Project |
author |
Toh, Darren Ting Yu |
author_sort |
Toh, Darren Ting Yu |
title |
Multipurpose microphone array using Raspberry Pi and MATRIX Creator |
title_short |
Multipurpose microphone array using Raspberry Pi and MATRIX Creator |
title_full |
Multipurpose microphone array using Raspberry Pi and MATRIX Creator |
title_fullStr |
Multipurpose microphone array using Raspberry Pi and MATRIX Creator |
title_full_unstemmed |
Multipurpose microphone array using Raspberry Pi and MATRIX Creator |
title_sort |
multipurpose microphone array using raspberry pi and matrix creator |
publisher |
Nanyang Technological University |
publishDate |
2020 |
url |
https://hdl.handle.net/10356/144643 |
_version_ |
1688665251878273024 |