An overview of outlier detection methods

Outlier detection is a necessary task; in many safety critical environments such as aircraft engine rotation failure, factory production line, network intrusion, and bust analysis. Most proposed methods are based on distance and density based outlier detection which simply detects outliers by calcul...

Full description

Saved in:
Bibliographic Details
Main Authors: Md. Sap, Mohd. Noor, Mohebi, Ehsan
Format: Article
Language:English
Published: Penerbit UTM Press 2008
Subjects:
Online Access:http://eprints.utm.my/id/eprint/39/1/MohdNoorMdSap2008_AnOverviewofOutlierDetectionMethods-.pdf
http://eprints.utm.my/id/eprint/39/
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Teknologi Malaysia
Language: English
id my.utm.39
record_format eprints
spelling my.utm.392017-11-01T04:17:24Z http://eprints.utm.my/id/eprint/39/ An overview of outlier detection methods Md. Sap, Mohd. Noor Mohebi, Ehsan VM Naval architecture. Shipbuilding. Marine engineering Outlier detection is a necessary task; in many safety critical environments such as aircraft engine rotation failure, factory production line, network intrusion, and bust analysis. Most proposed methods are based on distance and density based outlier detection which simply detects outliers by calculating distances or density between the data points. In high dimensional datasets, it's very difficult to find outliers with the measure of distance or density methods, because in such spaces the data become sparse and the imagination of data distribution is also hard. So with the curse of dimensionality we discuss a cluster based method that examines the behavior of the data in low dimensional projection. On the other hand most existing methods detect outliers with some parameters that needed to be defined by users in advance. In some cases it is very difficult for users to define these parameters. To solve such problems, example based method has been proposed. In this paper, wide and different modem technologies of outlier detection will be considered. Penerbit UTM Press 2008 Article PeerReviewed application/pdf en http://eprints.utm.my/id/eprint/39/1/MohdNoorMdSap2008_AnOverviewofOutlierDetectionMethods-.pdf Md. Sap, Mohd. Noor and Mohebi, Ehsan (2008) An overview of outlier detection methods. Jurnal Teknologi Maklumat, 20 (1). pp. 87-105. ISSN 0128-3790
institution Universiti Teknologi Malaysia
building UTM Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Teknologi Malaysia
content_source UTM Institutional Repository
url_provider http://eprints.utm.my/
language English
topic VM Naval architecture. Shipbuilding. Marine engineering
spellingShingle VM Naval architecture. Shipbuilding. Marine engineering
Md. Sap, Mohd. Noor
Mohebi, Ehsan
An overview of outlier detection methods
description Outlier detection is a necessary task; in many safety critical environments such as aircraft engine rotation failure, factory production line, network intrusion, and bust analysis. Most proposed methods are based on distance and density based outlier detection which simply detects outliers by calculating distances or density between the data points. In high dimensional datasets, it's very difficult to find outliers with the measure of distance or density methods, because in such spaces the data become sparse and the imagination of data distribution is also hard. So with the curse of dimensionality we discuss a cluster based method that examines the behavior of the data in low dimensional projection. On the other hand most existing methods detect outliers with some parameters that needed to be defined by users in advance. In some cases it is very difficult for users to define these parameters. To solve such problems, example based method has been proposed. In this paper, wide and different modem technologies of outlier detection will be considered.
format Article
author Md. Sap, Mohd. Noor
Mohebi, Ehsan
author_facet Md. Sap, Mohd. Noor
Mohebi, Ehsan
author_sort Md. Sap, Mohd. Noor
title An overview of outlier detection methods
title_short An overview of outlier detection methods
title_full An overview of outlier detection methods
title_fullStr An overview of outlier detection methods
title_full_unstemmed An overview of outlier detection methods
title_sort overview of outlier detection methods
publisher Penerbit UTM Press
publishDate 2008
url http://eprints.utm.my/id/eprint/39/1/MohdNoorMdSap2008_AnOverviewofOutlierDetectionMethods-.pdf
http://eprints.utm.my/id/eprint/39/
_version_ 1643643019912544256