Content-based Approach for Vietnamese Spam SMS Filtering

Short Message Service (SMS) spam is a serious problem in Vietnam because of the availability of very cheap prepaid SMS packages. There are some systems to detect and filter spam messages for English, most of which use machine learning techniques to analyze the content of messages and classify them....

Full description

Saved in:
Bibliographic Details
Main Authors: Pham, Thai-Hoang, Le-Hong, Phuong
Other Authors: 2016 International Conference on Asian Language Processing (IALP) (Tainan, Taiwan, 21-23 Nov. 2016)
Format: Conference or Workshop Item
Language:English
Published: IEEE 2019
Subjects:
Online Access:http://repository.vnu.edu.vn/handle/VNU_123/64923
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Vietnam National University, Hanoi
Language: English
id oai:112.137.131.14:VNU_123-64923
record_format dspace
spelling oai:112.137.131.14:VNU_123-649232019-08-27T05:49:45Z Content-based Approach for Vietnamese Spam SMS Filtering Pham, Thai-Hoang Le-Hong, Phuong 2016 International Conference on Asian Language Processing (IALP) (Tainan, Taiwan, 21-23 Nov. 2016) Short Message Service (SMS) Content-based Approach Vietnamese Spam SMS Filtering Short Message Service (SMS) spam is a serious problem in Vietnam because of the availability of very cheap prepaid SMS packages. There are some systems to detect and filter spam messages for English, most of which use machine learning techniques to analyze the content of messages and classify them. For Vietnamese, there is some research on spam email filtering but none focused on SMS. In this work, we propose the first system for filtering Vietnamese spam SMS. We first propose an appropriate preprocessing method since existing tools for Vietnamese preprocessing cannot give good accuracy on our dataset. We then experiment with vector representations and classifiers to find the best model for this problem. Our system achieves an accuracy of 94% when labelling spam messages while the misclassification rate of legitimate messages is relatively small, about only 0.4%. This is an encouraging result compared to that of English and can be served as a strong baseline for future development of Vietnamese SMS spam prevention systems. 2019-07-11T03:32:15Z 2019-07-11T03:32:15Z 2017 Conference Paper Pham, T. H., & Le-Hong, P. (2017). Content-based approach for Vietnamese spam SMS filtering. 2016 International Conference on Asian Language Processing (IALP). 978-1-5090-0922-0 http://repository.vnu.edu.vn/handle/VNU_123/64923 10.1109/IALP.2016.7875930 en Proceedings of the 2016 International Conference on Asian Language Processing, IALP 2016.; pp. 41-44 application/pdf IEEE
institution Vietnam National University, Hanoi
building VNU Library & Information Center
country Vietnam
collection VNU Digital Repository
language English
topic Short Message Service (SMS)
Content-based Approach
Vietnamese Spam SMS Filtering
spellingShingle Short Message Service (SMS)
Content-based Approach
Vietnamese Spam SMS Filtering
Pham, Thai-Hoang
Le-Hong, Phuong
Content-based Approach for Vietnamese Spam SMS Filtering
description Short Message Service (SMS) spam is a serious problem in Vietnam because of the availability of very cheap prepaid SMS packages. There are some systems to detect and filter spam messages for English, most of which use machine learning techniques to analyze the content of messages and classify them. For Vietnamese, there is some research on spam email filtering but none focused on SMS. In this work, we propose the first system for filtering Vietnamese spam SMS. We first propose an appropriate preprocessing method since existing tools for Vietnamese preprocessing cannot give good accuracy on our dataset. We then experiment with vector representations and classifiers to find the best model for this problem. Our system achieves an accuracy of 94% when labelling spam messages while the misclassification rate of legitimate messages is relatively small, about only 0.4%. This is an encouraging result compared to that of English and can be served as a strong baseline for future development of Vietnamese SMS spam prevention systems.
author2 2016 International Conference on Asian Language Processing (IALP) (Tainan, Taiwan, 21-23 Nov. 2016)
author_facet 2016 International Conference on Asian Language Processing (IALP) (Tainan, Taiwan, 21-23 Nov. 2016)
Pham, Thai-Hoang
Le-Hong, Phuong
format Conference or Workshop Item
author Pham, Thai-Hoang
Le-Hong, Phuong
author_sort Pham, Thai-Hoang
title Content-based Approach for Vietnamese Spam SMS Filtering
title_short Content-based Approach for Vietnamese Spam SMS Filtering
title_full Content-based Approach for Vietnamese Spam SMS Filtering
title_fullStr Content-based Approach for Vietnamese Spam SMS Filtering
title_full_unstemmed Content-based Approach for Vietnamese Spam SMS Filtering
title_sort content-based approach for vietnamese spam sms filtering
publisher IEEE
publishDate 2019
url http://repository.vnu.edu.vn/handle/VNU_123/64923
_version_ 1680968398017658880