A comparison of low-complexity real-time feature extraction for neuromorphic speech recognition

• Main Authors: Acharya, Jyotibdha, Patil, Aakash, Li, Xiaoya, Chen, Yi, Liu, Shih-Chii, Basu, Arindam
• Other Authors: Interdisciplinary Graduate School (IGS)
• Format: Article
• Language: English
• Published: 2018
• Subjects: Silicon Cochlea; Neural Engineering Framework
• Online Access: https://hdl.handle.net/10356/85120; http://hdl.handle.net/10220/45134
• Institution: Nanyang Technological University

This paper presents a real-time, low-complexity neuromorphic speech recognition system using a spiking silicon cochlea, a feature extraction module and a population encoding method based Neural Engineering Framework (NEF)/Extreme Learning Machine (ELM) classifier IC. Several feature extraction methods with varying memory and computational complexity are presented along with their corresponding classification accuracies. On the N-TIDIGITS18 dataset, we show that a fixed bin size based feature extraction method that votes across both time and spike count features can achieve an accuracy of 95% in software similar to previously report methods that use fixed number of bins per sample while using ~3× less energy and ~25× less memory for feature extraction (~1.5× less overall). Hardware measurements for the same topology show a slightly reduced accuracy of 94% that can be attributed to the extra correlations in hardware random weights. The hardware accuracy can be increased by further increasing the number of hidden nodes in ELM at the cost of memory and energy.