Autonomous learning machine for online big data analysis
Deep Metric Learning (DML) supports the non-linearity problem faced when unsupervised learning is used; whereby multi-input data corresponds to one output. Hence, DML is suitable for managing large imbalanced datasets which are often faced in the production industry in which a handful of defective p...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
Nanyang Technological University
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/156447 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-156447 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1564472022-04-16T14:20:51Z Autonomous learning machine for online big data analysis Ng, Jia Yu Mahardhika Pratama Zhang Jie School of Computer Science and Engineering ZhangJ@ntu.edu.sg, mpratama@ntu.edu.sg Engineering::Computer science and engineering Deep Metric Learning (DML) supports the non-linearity problem faced when unsupervised learning is used; whereby multi-input data corresponds to one output. Hence, DML is suitable for managing large imbalanced datasets which are often faced in the production industry in which a handful of defective products were manufactured. One of the methods used in DML is the autoencoders. The use of autoencoder information can be utilized in overcoming the convergence problem which arises when random samples are used for model training [1]. Two separate autoencoders were trained for normal products and defective products respectively. Next, the Triplet network is trained to learn an embedding of the feature vector representation of the products. The embedding prevents the convergence problem by moving each sample closer to its reconstruction restored with the same class’s autoencoder and further from the opposite class’s autoencoder [1]. Eventually, it allocates each sample to the associated autoencoder’s class, which recovers the sample’s nearest reconstruction in the embedding space. Bachelor of Engineering (Computer Science) 2022-04-16T14:20:16Z 2022-04-16T14:20:16Z 2022 Final Year Project (FYP) Ng, J. Y. (2022). Autonomous learning machine for online big data analysis. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156447 https://hdl.handle.net/10356/156447 en SCSE21-0291 application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering |
spellingShingle |
Engineering::Computer science and engineering Ng, Jia Yu Autonomous learning machine for online big data analysis |
description |
Deep Metric Learning (DML) supports the non-linearity problem faced when unsupervised learning is used; whereby multi-input data corresponds to one output. Hence, DML is suitable for managing large imbalanced datasets which are often faced in the production industry in which a handful of defective products were manufactured. One of the methods used in DML is the autoencoders. The use of autoencoder information can be utilized in overcoming the convergence problem which arises when random samples are used for model training [1]. Two separate autoencoders were trained for normal products and defective products respectively. Next, the Triplet network is trained to learn an embedding of the feature vector representation of the products. The embedding prevents the convergence problem by moving each sample closer to its reconstruction restored with the same class’s autoencoder and further from the opposite class’s autoencoder [1]. Eventually, it allocates each sample to the associated autoencoder’s class, which recovers the sample’s nearest reconstruction in the embedding space. |
author2 |
Mahardhika Pratama |
author_facet |
Mahardhika Pratama Ng, Jia Yu |
format |
Final Year Project |
author |
Ng, Jia Yu |
author_sort |
Ng, Jia Yu |
title |
Autonomous learning machine for online big data analysis |
title_short |
Autonomous learning machine for online big data analysis |
title_full |
Autonomous learning machine for online big data analysis |
title_fullStr |
Autonomous learning machine for online big data analysis |
title_full_unstemmed |
Autonomous learning machine for online big data analysis |
title_sort |
autonomous learning machine for online big data analysis |
publisher |
Nanyang Technological University |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/156447 |
_version_ |
1731235801448054784 |