Autonomous learning machine for online big data analysis

Deep Metric Learning (DML) supports the non-linearity problem faced when unsupervised learning is used; whereby multi-input data corresponds to one output. Hence, DML is suitable for managing large imbalanced datasets which are often faced in the production industry in which a handful of defective p...

Full description

Saved in:
Bibliographic Details
Main Author: Ng, Jia Yu
Other Authors: Mahardhika Pratama
Format: Final Year Project
Language:English
Published: Nanyang Technological University 2022
Subjects:
Online Access:https://hdl.handle.net/10356/156447
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-156447
record_format dspace
spelling sg-ntu-dr.10356-1564472022-04-16T14:20:51Z Autonomous learning machine for online big data analysis Ng, Jia Yu Mahardhika Pratama Zhang Jie School of Computer Science and Engineering ZhangJ@ntu.edu.sg, mpratama@ntu.edu.sg Engineering::Computer science and engineering Deep Metric Learning (DML) supports the non-linearity problem faced when unsupervised learning is used; whereby multi-input data corresponds to one output. Hence, DML is suitable for managing large imbalanced datasets which are often faced in the production industry in which a handful of defective products were manufactured. One of the methods used in DML is the autoencoders. The use of autoencoder information can be utilized in overcoming the convergence problem which arises when random samples are used for model training [1]. Two separate autoencoders were trained for normal products and defective products respectively. Next, the Triplet network is trained to learn an embedding of the feature vector representation of the products. The embedding prevents the convergence problem by moving each sample closer to its reconstruction restored with the same class’s autoencoder and further from the opposite class’s autoencoder [1]. Eventually, it allocates each sample to the associated autoencoder’s class, which recovers the sample’s nearest reconstruction in the embedding space. Bachelor of Engineering (Computer Science) 2022-04-16T14:20:16Z 2022-04-16T14:20:16Z 2022 Final Year Project (FYP) Ng, J. Y. (2022). Autonomous learning machine for online big data analysis. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156447 https://hdl.handle.net/10356/156447 en SCSE21-0291 application/pdf Nanyang Technological University
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Computer science and engineering
spellingShingle Engineering::Computer science and engineering
Ng, Jia Yu
Autonomous learning machine for online big data analysis
description Deep Metric Learning (DML) supports the non-linearity problem faced when unsupervised learning is used; whereby multi-input data corresponds to one output. Hence, DML is suitable for managing large imbalanced datasets which are often faced in the production industry in which a handful of defective products were manufactured. One of the methods used in DML is the autoencoders. The use of autoencoder information can be utilized in overcoming the convergence problem which arises when random samples are used for model training [1]. Two separate autoencoders were trained for normal products and defective products respectively. Next, the Triplet network is trained to learn an embedding of the feature vector representation of the products. The embedding prevents the convergence problem by moving each sample closer to its reconstruction restored with the same class’s autoencoder and further from the opposite class’s autoencoder [1]. Eventually, it allocates each sample to the associated autoencoder’s class, which recovers the sample’s nearest reconstruction in the embedding space.
author2 Mahardhika Pratama
author_facet Mahardhika Pratama
Ng, Jia Yu
format Final Year Project
author Ng, Jia Yu
author_sort Ng, Jia Yu
title Autonomous learning machine for online big data analysis
title_short Autonomous learning machine for online big data analysis
title_full Autonomous learning machine for online big data analysis
title_fullStr Autonomous learning machine for online big data analysis
title_full_unstemmed Autonomous learning machine for online big data analysis
title_sort autonomous learning machine for online big data analysis
publisher Nanyang Technological University
publishDate 2022
url https://hdl.handle.net/10356/156447
_version_ 1731235801448054784