Siamese networks for speaker identification on resource-constrained platforms

• Main Authors: Lim, Jun Jie, Ahmad Zabidi, Muhammad Mun’im, Abdul Manan, Shahidatul Sadiah, Ab. Rahman, Ab. Al-Hadi
• Format: Conference or Workshop Item
• Language: English
• Published: 2023
• Subjects: TK Electrical engineering. Electronics Nuclear engineering
• Online Access: http://eprints.utm.my/107836/1/MuhammadMunim2023_SiameseNetworksforSpeakerIdentification.pdf; http://eprints.utm.my/107836/; http://dx.doi.org/10.1088/1742-6596/2622/1/012014
• Institution: Universiti Teknologi Malaysia

This paper investigates the implementation of a lightweight Siamese neural network for enhancing speaker identification accuracy and inference speed in embedded systems. Integrating speaker identification into embedded systems can improve portability and versatility. Siamese neural networks achieve speaker identification by comparing input voice samples to reference voices in a database, effectively extracting features and classifying speakers accurately. Considering the trade-off between accuracy and complexity, as well as hardware constraints in embedded systems, various neural networks could be applied to speaker identification. This paper compares the incorporation of CNN architectures targeted for embedded systems, MCUNet, SqueezeNet and MobileNetv2, to implement Siamese neural networks on a Raspberry Pi. Our experiments demonstrate that MCUNet achieves 85% accuracy with a 0.23-second inference time. In comparison, the larger MobileNetv2 attains 84.5% accuracy with a 0.32-second inference time. Additionally, contrastive loss was superior to binary cross-entropy loss in the Siamese neural network. The system using contrastive loss had almost 68% lower loss scores, resulting in a more stable performance and more accurate predictions. In conclusion, this paper establishes that an appropriate lightweight Siamese neural network, combined with contrastive loss, can significantly improve speaker identification accuracy, and enable efficient deployment on resource-constrained platforms.