Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
Early prediction of students’ learning performance and analysis of student behavior in a virtual learning environment (VLE) are crucial to minimize the high failure rate in online courses during the COVID-19 pandemic. Nevertheless, traditional machine learning models fail to predict student performa...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | Article PeerReviewed |
Language: | English |
Published: |
MDPI
2022
|
Subjects: | |
Online Access: | https://repository.ugm.ac.id/282194/1/Chen%20et%20al.%20-%202022%20-%20Week-wise%20student%20performance%20early%20prediction%20in%20.pdf https://repository.ugm.ac.id/282194/ https://www.mdpi.com/2076-3417/12/4/1885 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Universitas Gadjah Mada |
Language: | English |
id |
id-ugm-repo.282194 |
---|---|
record_format |
dspace |
spelling |
id-ugm-repo.2821942023-11-28T07:32:15Z https://repository.ugm.ac.id/282194/ Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence Chen, Hsing-Chung Prasetyo, Eko Tseng, Shian-Shyong Putra, Karisma Trinanda Prayitno, Prayitno Kusumawardani, Sri Suning Weng, Chien-Erh Electrical and Electronic Engineering not elsewhere classified Early prediction of students’ learning performance and analysis of student behavior in a virtual learning environment (VLE) are crucial to minimize the high failure rate in online courses during the COVID-19 pandemic. Nevertheless, traditional machine learning models fail to predict student performance in the early weeks due to the lack of students’ activities’ data in a week-wise timely manner (i.e., spatiotemporal feature issues). Furthermore, the imbalanced data distribution in the VLE impacts the prediction model performance. Thus, there are severe challenges in handling spatiotemporal features, imbalanced data sets, and a lack of explainability for enhancing the confidence of the prediction system. Therefore, an intelligent framework for explainable student performance prediction (ESPP) is proposed in this study in order to provide the interpretability of the prediction results. First, this framework utilized a time-series weekly student activity data set and dealt with the VLE imbalanced data distribution using a hybrid data sampling method. Then, a combination of convolutional neural network (CNN) and long short-term memory (LSTM) was employed to extract the spatiotemporal features and develop the early prediction deep learning (DL) model. Finally, the DL model was explained by visualizing and analyzing typical predictions, students’ activities’ maps, and feature importance. The numerical results of cross-validation showed that the proposed new DL model (i.e., the combined CNN-LSTM and ConvLSTM), in the early prediction cases, performed better than the baseline models of LSTM, support vector machine (SVM), and logistic regression (LR) models. © 2022 by the authors. Licensee MDPI, Basel, Switzerland. MDPI 2022 Article PeerReviewed application/pdf en https://repository.ugm.ac.id/282194/1/Chen%20et%20al.%20-%202022%20-%20Week-wise%20student%20performance%20early%20prediction%20in%20.pdf Chen, Hsing-Chung and Prasetyo, Eko and Tseng, Shian-Shyong and Putra, Karisma Trinanda and Prayitno, Prayitno and Kusumawardani, Sri Suning and Weng, Chien-Erh (2022) Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence. Applied Sciences (Switzerland), 12 (4). pp. 1-16. ISSN 20763417 https://www.mdpi.com/2076-3417/12/4/1885 |
institution |
Universitas Gadjah Mada |
building |
UGM Library |
continent |
Asia |
country |
Indonesia Indonesia |
content_provider |
UGM Library |
collection |
Repository Civitas UGM |
language |
English |
topic |
Electrical and Electronic Engineering not elsewhere classified |
spellingShingle |
Electrical and Electronic Engineering not elsewhere classified Chen, Hsing-Chung Prasetyo, Eko Tseng, Shian-Shyong Putra, Karisma Trinanda Prayitno, Prayitno Kusumawardani, Sri Suning Weng, Chien-Erh Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence |
description |
Early prediction of students’ learning performance and analysis of student behavior in a virtual learning environment (VLE) are crucial to minimize the high failure rate in online courses during the COVID-19 pandemic. Nevertheless, traditional machine learning models fail to predict student performance in the early weeks due to the lack of students’ activities’ data in a week-wise timely manner (i.e., spatiotemporal feature issues). Furthermore, the imbalanced data distribution in the VLE impacts the prediction model performance. Thus, there are severe challenges in handling spatiotemporal features, imbalanced data sets, and a lack of explainability for enhancing the confidence of the prediction system. Therefore, an intelligent framework for explainable student performance prediction (ESPP) is proposed in this study in order to provide the interpretability of the prediction results. First, this framework utilized a time-series weekly student activity data set and dealt with the VLE imbalanced data distribution using a hybrid data sampling method. Then, a combination of convolutional neural network (CNN) and long short-term memory (LSTM) was employed to extract the spatiotemporal features and develop the early prediction deep learning (DL) model. Finally, the DL model was explained by visualizing and analyzing typical predictions, students’ activities’ maps, and feature importance. The numerical results of cross-validation showed that the proposed new DL model (i.e., the combined CNN-LSTM and ConvLSTM), in the early prediction cases, performed better than the baseline models of LSTM, support vector machine (SVM), and logistic regression (LR) models. © 2022 by the authors. Licensee MDPI, Basel, Switzerland. |
format |
Article PeerReviewed |
author |
Chen, Hsing-Chung Prasetyo, Eko Tseng, Shian-Shyong Putra, Karisma Trinanda Prayitno, Prayitno Kusumawardani, Sri Suning Weng, Chien-Erh |
author_facet |
Chen, Hsing-Chung Prasetyo, Eko Tseng, Shian-Shyong Putra, Karisma Trinanda Prayitno, Prayitno Kusumawardani, Sri Suning Weng, Chien-Erh |
author_sort |
Chen, Hsing-Chung |
title |
Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence |
title_short |
Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence |
title_full |
Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence |
title_fullStr |
Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence |
title_full_unstemmed |
Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence |
title_sort |
week-wise student performance early prediction in virtual learning environment using a deep explainable artificial intelligence |
publisher |
MDPI |
publishDate |
2022 |
url |
https://repository.ugm.ac.id/282194/1/Chen%20et%20al.%20-%202022%20-%20Week-wise%20student%20performance%20early%20prediction%20in%20.pdf https://repository.ugm.ac.id/282194/ https://www.mdpi.com/2076-3417/12/4/1885 |
_version_ |
1783956286646255616 |