DNN-FES & Fole : objective loss estimator for integrating deep neural-network into fuzzy systems

• Main Author: Dandapath, Soham
• Other Authors: Quek Hiok Chai
• Format: Final Year Project
• Language: English
• Published: Nanyang Technological University 2021
• Subjects: Engineering::Computer science and engineering
• Online Access: https://hdl.handle.net/10356/153483
• Institution: Nanyang Technological University

For many years, deep learning has been a popular study area. Its effectiveness in a variety of applications has led to immense research in this sector, leading to several neural network architecture that are as accurate as humans. Despite possessing human-like accuracy, deep neural networks mostly lack human like cognition which explains the reasoning behind their decisions, making them akin to a black box. Fuzzy Systems, on the other hand, are based on human-like reasoning, inspired by the brain's hippocampus. However, they are vulnerable to outliers and do not generalize well unlike the deep neural networks making them quite fragile. Attempts to merge these two fields are nothing new. However, owing to the use of non-differentiable membership functions in fuzzy systems, neuro fuzzy systems based on the Mamdani inference scheme have only been able to adapt the structure of the neural network and not the learning mechanism. Deep Neural Network - Fuzzy Embedded System (DNN-FES) is a unique architecture based on the Mamdani inference scheme. It aims to replace a normal T-norm with a neural network that learns the inference process using learning mechanism of the neural network. We also introduce Fuzzy Object Loss Estimator (FOLE) to leverage backpropagation algorithm of neural networks into the neuro fuzzy system. FOLE is an objective loss function in the sense that it not only tries to minimize the error incurred from the target and predicted value, but also the loss incurred in making inadmissible or unjustifiable rule. In most of the benchmarking tests, DNN-FES has proved to produce state-of-the-art results. For the application of DNN-FES in stock market prediction, the results have shown quite promising results making it a potential candidate for its usage in stock market trading and portfolio balancing.