Efficient implementation of activation functions for LSTM accelerators

• المؤلفون الرئيسيون: Chong, Yi Sheng, Goh, Wang Ling, Ong, Yew-Soon, Nambiar, Vishnu P., Do, Anh Tuan
• مؤلفون آخرون: School of Electrical and Electronic Engineering
• التنسيق: Conference or Workshop Item
• اللغة: English
• منشور في: 2021
• الموضوعات: Engineering::Electrical and electronic engineering::Integrated circuits; Activation function; Long Short Term Memory Accelerator
• الوصول للمادة أونلاين: https://hdl.handle.net/10356/153121
• المؤسسة: Nanyang Technological University

Activation functions such as hyperbolic tangent (tanh) and logistic sigmoid (sigmoid) are critical computing elements in a long short term memory (LSTM) cell and network. These activation functions are non-linear, leading to challenges in their hardware implementations. Area-efficient and high perf...