Training set size reduction in large dataset problems

© 2015 IEEE. Classifiers have known to be used in various fields of applications. However, the main problem usually found recently is about applying a classifier to large datasets. Thus, the process of reducing size of the training set becomes necessary especially to accelerate the processing time o...

Full description

Saved in:
Bibliographic Details
Main Authors: Chouvatut V., Jindaluang W., Boonchieng E.
Format: Conference Proceeding
Published: 2017
Online Access:https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84964320834&origin=inward
http://cmuir.cmu.ac.th/jspui/handle/6653943832/42095
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Chiang Mai University
id th-cmuir.6653943832-42095
record_format dspace
spelling th-cmuir.6653943832-420952017-09-28T04:25:12Z Training set size reduction in large dataset problems Chouvatut V. Jindaluang W. Boonchieng E. © 2015 IEEE. Classifiers have known to be used in various fields of applications. However, the main problem usually found recently is about applying a classifier to large datasets. Thus, the process of reducing size of the training set becomes necessary especially to accelerate the processing time of the classifier. Concerning the problem, this paper proposes a new method which can reduce size of the training set in a large dataset. Our proposed method is improved from a famous graph-based algorithm named Optimum-Path Forest (OPF). Our principal concept of reducing the training set's size is to utilize the Segmented Least Square Algorithm (SLSA) in estimating the tree's shape. From the experimental results, our proposed method could reduce size of the training set by about 7 to 21 percent comparing with the original OPF algorithm while the classification's accuracy decreased insignificantly by only about 0.2 to 0.5 percent. In addition, for some datasets, our method provided even as same degree of accuracy as of the original OPF algorithm. 2017-09-28T04:25:12Z 2017-09-28T04:25:12Z 2016-02-08 Conference Proceeding 2-s2.0-84964320834 10.1109/ICSEC.2015.7401435 https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84964320834&origin=inward http://cmuir.cmu.ac.th/jspui/handle/6653943832/42095
institution Chiang Mai University
building Chiang Mai University Library
country Thailand
collection CMU Intellectual Repository
description © 2015 IEEE. Classifiers have known to be used in various fields of applications. However, the main problem usually found recently is about applying a classifier to large datasets. Thus, the process of reducing size of the training set becomes necessary especially to accelerate the processing time of the classifier. Concerning the problem, this paper proposes a new method which can reduce size of the training set in a large dataset. Our proposed method is improved from a famous graph-based algorithm named Optimum-Path Forest (OPF). Our principal concept of reducing the training set's size is to utilize the Segmented Least Square Algorithm (SLSA) in estimating the tree's shape. From the experimental results, our proposed method could reduce size of the training set by about 7 to 21 percent comparing with the original OPF algorithm while the classification's accuracy decreased insignificantly by only about 0.2 to 0.5 percent. In addition, for some datasets, our method provided even as same degree of accuracy as of the original OPF algorithm.
format Conference Proceeding
author Chouvatut V.
Jindaluang W.
Boonchieng E.
spellingShingle Chouvatut V.
Jindaluang W.
Boonchieng E.
Training set size reduction in large dataset problems
author_facet Chouvatut V.
Jindaluang W.
Boonchieng E.
author_sort Chouvatut V.
title Training set size reduction in large dataset problems
title_short Training set size reduction in large dataset problems
title_full Training set size reduction in large dataset problems
title_fullStr Training set size reduction in large dataset problems
title_full_unstemmed Training set size reduction in large dataset problems
title_sort training set size reduction in large dataset problems
publishDate 2017
url https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=84964320834&origin=inward
http://cmuir.cmu.ac.th/jspui/handle/6653943832/42095
_version_ 1681422124436160512