Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence

Early prediction of students’ learning performance and analysis of student behavior in a virtual learning environment (VLE) are crucial to minimize the high failure rate in online courses during the COVID-19 pandemic. Nevertheless, traditional machine learning models fail to predict student performa...

Full description

Saved in:
Bibliographic Details
Main Authors: Chen, Hsing-Chung, Prasetyo, Eko, Tseng, Shian-Shyong, Putra, Karisma Trinanda, Prayitno, Prayitno, Kusumawardani, Sri Suning, Weng, Chien-Erh
Format: Article PeerReviewed
Language:English
Published: MDPI 2022
Subjects:
Online Access:https://repository.ugm.ac.id/282194/1/Chen%20et%20al.%20-%202022%20-%20Week-wise%20student%20performance%20early%20prediction%20in%20.pdf
https://repository.ugm.ac.id/282194/
https://www.mdpi.com/2076-3417/12/4/1885
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universitas Gadjah Mada
Language: English
id id-ugm-repo.282194
record_format dspace
spelling id-ugm-repo.2821942023-11-28T07:32:15Z https://repository.ugm.ac.id/282194/ Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence Chen, Hsing-Chung Prasetyo, Eko Tseng, Shian-Shyong Putra, Karisma Trinanda Prayitno, Prayitno Kusumawardani, Sri Suning Weng, Chien-Erh Electrical and Electronic Engineering not elsewhere classified Early prediction of students’ learning performance and analysis of student behavior in a virtual learning environment (VLE) are crucial to minimize the high failure rate in online courses during the COVID-19 pandemic. Nevertheless, traditional machine learning models fail to predict student performance in the early weeks due to the lack of students’ activities’ data in a week-wise timely manner (i.e., spatiotemporal feature issues). Furthermore, the imbalanced data distribution in the VLE impacts the prediction model performance. Thus, there are severe challenges in handling spatiotemporal features, imbalanced data sets, and a lack of explainability for enhancing the confidence of the prediction system. Therefore, an intelligent framework for explainable student performance prediction (ESPP) is proposed in this study in order to provide the interpretability of the prediction results. First, this framework utilized a time-series weekly student activity data set and dealt with the VLE imbalanced data distribution using a hybrid data sampling method. Then, a combination of convolutional neural network (CNN) and long short-term memory (LSTM) was employed to extract the spatiotemporal features and develop the early prediction deep learning (DL) model. Finally, the DL model was explained by visualizing and analyzing typical predictions, students’ activities’ maps, and feature importance. The numerical results of cross-validation showed that the proposed new DL model (i.e., the combined CNN-LSTM and ConvLSTM), in the early prediction cases, performed better than the baseline models of LSTM, support vector machine (SVM), and logistic regression (LR) models. © 2022 by the authors. Licensee MDPI, Basel, Switzerland. MDPI 2022 Article PeerReviewed application/pdf en https://repository.ugm.ac.id/282194/1/Chen%20et%20al.%20-%202022%20-%20Week-wise%20student%20performance%20early%20prediction%20in%20.pdf Chen, Hsing-Chung and Prasetyo, Eko and Tseng, Shian-Shyong and Putra, Karisma Trinanda and Prayitno, Prayitno and Kusumawardani, Sri Suning and Weng, Chien-Erh (2022) Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence. Applied Sciences (Switzerland), 12 (4). pp. 1-16. ISSN 20763417 https://www.mdpi.com/2076-3417/12/4/1885
institution Universitas Gadjah Mada
building UGM Library
continent Asia
country Indonesia
Indonesia
content_provider UGM Library
collection Repository Civitas UGM
language English
topic Electrical and Electronic Engineering not elsewhere classified
spellingShingle Electrical and Electronic Engineering not elsewhere classified
Chen, Hsing-Chung
Prasetyo, Eko
Tseng, Shian-Shyong
Putra, Karisma Trinanda
Prayitno, Prayitno
Kusumawardani, Sri Suning
Weng, Chien-Erh
Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
description Early prediction of students’ learning performance and analysis of student behavior in a virtual learning environment (VLE) are crucial to minimize the high failure rate in online courses during the COVID-19 pandemic. Nevertheless, traditional machine learning models fail to predict student performance in the early weeks due to the lack of students’ activities’ data in a week-wise timely manner (i.e., spatiotemporal feature issues). Furthermore, the imbalanced data distribution in the VLE impacts the prediction model performance. Thus, there are severe challenges in handling spatiotemporal features, imbalanced data sets, and a lack of explainability for enhancing the confidence of the prediction system. Therefore, an intelligent framework for explainable student performance prediction (ESPP) is proposed in this study in order to provide the interpretability of the prediction results. First, this framework utilized a time-series weekly student activity data set and dealt with the VLE imbalanced data distribution using a hybrid data sampling method. Then, a combination of convolutional neural network (CNN) and long short-term memory (LSTM) was employed to extract the spatiotemporal features and develop the early prediction deep learning (DL) model. Finally, the DL model was explained by visualizing and analyzing typical predictions, students’ activities’ maps, and feature importance. The numerical results of cross-validation showed that the proposed new DL model (i.e., the combined CNN-LSTM and ConvLSTM), in the early prediction cases, performed better than the baseline models of LSTM, support vector machine (SVM), and logistic regression (LR) models. © 2022 by the authors. Licensee MDPI, Basel, Switzerland.
format Article
PeerReviewed
author Chen, Hsing-Chung
Prasetyo, Eko
Tseng, Shian-Shyong
Putra, Karisma Trinanda
Prayitno, Prayitno
Kusumawardani, Sri Suning
Weng, Chien-Erh
author_facet Chen, Hsing-Chung
Prasetyo, Eko
Tseng, Shian-Shyong
Putra, Karisma Trinanda
Prayitno, Prayitno
Kusumawardani, Sri Suning
Weng, Chien-Erh
author_sort Chen, Hsing-Chung
title Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
title_short Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
title_full Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
title_fullStr Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
title_full_unstemmed Week-Wise Student Performance Early Prediction in Virtual Learning Environment Using a Deep Explainable Artificial Intelligence
title_sort week-wise student performance early prediction in virtual learning environment using a deep explainable artificial intelligence
publisher MDPI
publishDate 2022
url https://repository.ugm.ac.id/282194/1/Chen%20et%20al.%20-%202022%20-%20Week-wise%20student%20performance%20early%20prediction%20in%20.pdf
https://repository.ugm.ac.id/282194/
https://www.mdpi.com/2076-3417/12/4/1885
_version_ 1783956286646255616