Sequence prediction using recurrent neural network

• Main Author: Nguyen, Phan Huy
• Other Authors: Goh Wooi Boon
• Format: Final Year Project
• Language: English
• Published: 2017
• Subjects: DRNTU::Engineering::Computer science and engineering
• Online Access: http://hdl.handle.net/10356/70503
• Institution: Nanyang Technological University

The project implemented a Gap-Filling Engine capable of filling in gaps in missing sequences of various types. A strategy was introduced to look forward into subsequent data, enabling the Engine to improve the accuracy of the prediction by more than 30%. A Sequence Model based on Long Short-term Memory (LSTM) Recurrent Neural Network was used to learn patterns in several sequence types. Optimization technique by caching the LSTM was implemented, shortening runtime by several hundred times, allowing significantly more experiments to be executed. Performance evaluation strategy was designed and carried out to analyze the impact of various factors on the Gap-Filling Engine, providing a better understand of the Engine, as well as recommendations for users. The Gap-Filling Engine shows potentials of applications on several fields, especially in reconstructing structured sequential data with missing values.