Online Passive Aggressive Active Learning and its Applications
We investigate online active learning techniques for classification tasks in data stream mining applications. Unlike traditional learning approaches (either batch or online learning) that often require to request the class label of each incoming instance, online active learning queries only a subset...
Saved in:
Main Authors: | , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2014
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/2640 https://ink.library.smu.edu.sg/context/sis_research/article/3640/viewcontent/lu_HOI_14.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-3640 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-36402018-12-03T01:02:09Z Online Passive Aggressive Active Learning and its Applications LU, Jing ZHAO, Peilin HOI, Steven C. H. We investigate online active learning techniques for classification tasks in data stream mining applications. Unlike traditional learning approaches (either batch or online learning) that often require to request the class label of each incoming instance, online active learning queries only a subset of informative incoming instances to update the classification model, which aims to maximize classification performance using minimal human labeling effort during the entire online stream data mining task. In this paper, we present a new family of algorithms for online active learning called Passive-Aggressive Active (PAA) learning algorithms by adapting the popular Passive-Aggressive algorithms in an online active learning setting. Unlike the conventional Perceptron-based approach that employs only the misclassified instances for updating the model, the proposed PAA learning algorithms not only use the misclassified instances to update the classifier, but also exploit correctly classified examples with low prediction confidence. We theoretically analyse the mistake bounds of the proposed algorithms and conduct extensive experiments to examine their empirical performance, in which encouraging results show clear advantages of our algorithms over the baselines. 2014-11-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/2640 https://ink.library.smu.edu.sg/context/sis_research/article/3640/viewcontent/lu_HOI_14.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Online Learning Data Stream Active Learning Passive-Aggressive Databases and Information Systems Numerical Analysis and Scientific Computing |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Online Learning Data Stream Active Learning Passive-Aggressive Databases and Information Systems Numerical Analysis and Scientific Computing |
spellingShingle |
Online Learning Data Stream Active Learning Passive-Aggressive Databases and Information Systems Numerical Analysis and Scientific Computing LU, Jing ZHAO, Peilin HOI, Steven C. H. Online Passive Aggressive Active Learning and its Applications |
description |
We investigate online active learning techniques for classification tasks in data stream mining applications. Unlike traditional learning approaches (either batch or online learning) that often require to request the class label of each incoming instance, online active learning queries only a subset of informative incoming instances to update the classification model, which aims to maximize classification performance using minimal human labeling effort during the entire online stream data mining task. In this paper, we present a new family of algorithms for online active learning called Passive-Aggressive Active (PAA) learning algorithms by adapting the popular Passive-Aggressive algorithms in an online active learning setting. Unlike the conventional Perceptron-based approach that employs only the misclassified instances for updating the model, the proposed PAA learning algorithms not only use the misclassified instances to update the classifier, but also exploit correctly classified examples with low prediction confidence. We theoretically analyse the mistake bounds of the proposed algorithms and conduct extensive experiments to examine their empirical performance, in which encouraging results show clear advantages of our algorithms over the baselines. |
format |
text |
author |
LU, Jing ZHAO, Peilin HOI, Steven C. H. |
author_facet |
LU, Jing ZHAO, Peilin HOI, Steven C. H. |
author_sort |
LU, Jing |
title |
Online Passive Aggressive Active Learning and its Applications |
title_short |
Online Passive Aggressive Active Learning and its Applications |
title_full |
Online Passive Aggressive Active Learning and its Applications |
title_fullStr |
Online Passive Aggressive Active Learning and its Applications |
title_full_unstemmed |
Online Passive Aggressive Active Learning and its Applications |
title_sort |
online passive aggressive active learning and its applications |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2014 |
url |
https://ink.library.smu.edu.sg/sis_research/2640 https://ink.library.smu.edu.sg/context/sis_research/article/3640/viewcontent/lu_HOI_14.pdf |
_version_ |
1770572534007201792 |