Non-Parametric Stochastic Autoencoder Model for Anomaly Detection
Anomaly detection is a widely studied field in computer science with applications ranging from intrusion detection, fraud detection, medical diagnosis and quality assurance in manufacturing. The underlying premise is that an anomaly is an observation that does not conform to what is considered to be...
Saved in:
Main Authors: | , |
---|---|
Format: | text |
Published: |
Archīum Ateneo
2022
|
Subjects: | |
Online Access: | https://archium.ateneo.edu/discs-faculty-pubs/342 https://archium.ateneo.edu/cgi/viewcontent.cgi?article=1342&context=discs-faculty-pubs |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Ateneo De Manila University |
id |
ph-ateneo-arc.discs-faculty-pubs-1342 |
---|---|
record_format |
eprints |
spelling |
ph-ateneo-arc.discs-faculty-pubs-13422022-12-06T02:41:01Z Non-Parametric Stochastic Autoencoder Model for Anomaly Detection Alampay, Raphael B Abu, Patricia Angela R Anomaly detection is a widely studied field in computer science with applications ranging from intrusion detection, fraud detection, medical diagnosis and quality assurance in manufacturing. The underlying premise is that an anomaly is an observation that does not conform to what is considered to be normal. This study addresses two major problems in the field. First, anomalies are defined in a local context, that is, being able to give quantitative measures as to how anomalies are categorized within its own problem domain and cannot be generalized to other domains. Commonly, anomalies are measured according to statistical probabilities relative to the entire dataset with several assumptions such as type of distribution and volume. Second, the performance of a model is dependent on the problem itself. As a machine learning problem, each model has to have parameters optimized to achieve acceptable performance specifically thresholds that are either defined by domain experts of manually adjusted. This study attempts to address these problems by providing a contextual approach to measuring anomaly detection datasets themselves through a quantitative approach called categorical measures that provides constraints to the problem of anomaly detection and proposes a robust model based on autoencoder neural networks whose parameters are dynamically adjusted in order to avoid parameter tweaking on the inferencing stage. Empirically, the study has conducted a relatively exhaustive experiment against existing and state of the art anomaly detection models in a semi-supervised learning approach where the assumption is that only normal data is available to provide insight as to how well the model performs under certain quantifiable anomaly detection scenarios. 2022-01-01T08:00:00Z text application/pdf https://archium.ateneo.edu/discs-faculty-pubs/342 https://archium.ateneo.edu/cgi/viewcontent.cgi?article=1342&context=discs-faculty-pubs Department of Information Systems & Computer Science Faculty Publications Archīum Ateneo Neural networks autoencoders machine learning anomaly detection semi-supervised learning Computer Sciences Databases and Information Systems Electrical and Computer Engineering Physical Sciences and Mathematics |
institution |
Ateneo De Manila University |
building |
Ateneo De Manila University Library |
continent |
Asia |
country |
Philippines Philippines |
content_provider |
Ateneo De Manila University Library |
collection |
archium.Ateneo Institutional Repository |
topic |
Neural networks autoencoders machine learning anomaly detection semi-supervised learning Computer Sciences Databases and Information Systems Electrical and Computer Engineering Physical Sciences and Mathematics |
spellingShingle |
Neural networks autoencoders machine learning anomaly detection semi-supervised learning Computer Sciences Databases and Information Systems Electrical and Computer Engineering Physical Sciences and Mathematics Alampay, Raphael B Abu, Patricia Angela R Non-Parametric Stochastic Autoencoder Model for Anomaly Detection |
description |
Anomaly detection is a widely studied field in computer science with applications ranging from intrusion detection, fraud detection, medical diagnosis and quality assurance in manufacturing. The underlying premise is that an anomaly is an observation that does not conform to what is considered to be normal. This study addresses two major problems in the field. First, anomalies are defined in a local context, that is, being able to give quantitative measures as to how anomalies are categorized within its own problem domain and cannot be generalized to other domains. Commonly, anomalies are measured according to statistical probabilities relative to the entire dataset with several assumptions such as type of distribution and volume. Second, the performance of a model is dependent on the problem itself. As a machine learning problem, each model has to have parameters optimized to achieve acceptable performance specifically thresholds that are either defined by domain experts of manually adjusted. This study attempts to address these problems by providing a contextual approach to measuring anomaly detection datasets themselves through a quantitative approach called categorical measures that provides constraints to the problem of anomaly detection and proposes a robust model based on autoencoder neural networks whose parameters are dynamically adjusted in order to avoid parameter tweaking on the inferencing stage. Empirically, the study has conducted a relatively exhaustive experiment against existing and state of the art anomaly detection models in a semi-supervised learning approach where the assumption is that only normal data is available to provide insight as to how well the model performs under certain quantifiable anomaly detection scenarios. |
format |
text |
author |
Alampay, Raphael B Abu, Patricia Angela R |
author_facet |
Alampay, Raphael B Abu, Patricia Angela R |
author_sort |
Alampay, Raphael B |
title |
Non-Parametric Stochastic Autoencoder Model for Anomaly Detection |
title_short |
Non-Parametric Stochastic Autoencoder Model for Anomaly Detection |
title_full |
Non-Parametric Stochastic Autoencoder Model for Anomaly Detection |
title_fullStr |
Non-Parametric Stochastic Autoencoder Model for Anomaly Detection |
title_full_unstemmed |
Non-Parametric Stochastic Autoencoder Model for Anomaly Detection |
title_sort |
non-parametric stochastic autoencoder model for anomaly detection |
publisher |
Archīum Ateneo |
publishDate |
2022 |
url |
https://archium.ateneo.edu/discs-faculty-pubs/342 https://archium.ateneo.edu/cgi/viewcontent.cgi?article=1342&context=discs-faculty-pubs |
_version_ |
1751550494848843776 |