Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness

Enhancing learning effectiveness requires one to define suitable learning outcomes and align assessment constructs with these outcomes. We present a quad-faceted feature-based graph network to classify assessment texts into domain-agnostic class labels more accurately. The proposed model incorporate...

Full description

Saved in:
Bibliographic Details
Main Authors: Supraja, S., Khong, Andy Wai Hoong
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2025
Subjects:
Online Access:https://hdl.handle.net/10356/182007
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-182007
record_format dspace
spelling sg-ntu-dr.10356-1820072025-01-10T15:43:57Z Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness Supraja, S. Khong, Andy Wai Hoong School of Electrical and Electronic Engineering Lee Kong Chian School of Medicine (LKCMedicine) Engineering Nested phrases Regular expressions Enhancing learning effectiveness requires one to define suitable learning outcomes and align assessment constructs with these outcomes. We present a quad-faceted feature-based graph network to classify assessment texts into domain-agnostic class labels more accurately. The proposed model incorporates four complementary graphs (syntactic, semantic, sequential, and topical) with observable and latent node types and unique edge weight computations that are dependent on node properties to extract unique features from a given text. The purpose of incorporating syntactic information is to consider the dependency parsing between word nodes, while the semantic information is to provide the algorithm with contextual similarity between phrase nodes that are more effective than words in encapsulating the meaning of a text. The sequential graph is applied to regular expression nodes that contribute to a domain-agnostic class label, while the topical graph identifies topics that are convergent to each other based on their distributions. As opposed to existing techniques that construct graphs solely based on word nodes, the proposed model exploits the benefits of term weighting, nested phrases, regular expressions, and topic modeling to develop a diverse heterogeneous architecture for text classification. We evaluate the classification performance on questions with different class labels such as cognitive complexities, reasoning capabilities, and question types, as well as longer documents. Experiment results show that the proposed model outperforms in terms of macroaverage F1 score when compared with existing deep learning techniques. We also demonstrate the application of the classification model to understand learners' attitudes via an empirical study in a workplace-learning environment. Ministry of Education (MOE) National Research Foundation (NRF) Submitted/Accepted version This work was supported in part by the Ministry of Education, Singapore, under its MOE Tertiary Education Research Fund (MOE-TRF) under Award MOE2019-TRF-035, in part by the Delta-NTU Corporate Lab for Cyber–Physical Systems through Delta Electronics Inc., and in part by the National Research Foundation (NRF) Singapore under the CorpLab@University Scheme. 2025-01-06T01:35:14Z 2025-01-06T01:35:14Z 2024 Journal Article Supraja, S. & Khong, A. W. H. (2024). Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness. IEEE Transactions On Computational Social Systems, 11(6), 7500-7515. https://dx.doi.org/10.1109/TCSS.2024.3421632 2329-924X https://hdl.handle.net/10356/182007 10.1109/TCSS.2024.3421632 2-s2.0-85211596567 6 11 7500 7515 en MOE2019-TRF-035 IEEE Transactions on Computational Social Systems © 2024 IEEE. All rights reserved. This article may be downloaded for personal use only. Any other use requires prior permission of the copyright holder. The Version of Record is available online at http://doi.org/10.1109/TCSS.2024.3421632. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering
Nested phrases
Regular expressions
spellingShingle Engineering
Nested phrases
Regular expressions
Supraja, S.
Khong, Andy Wai Hoong
Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
description Enhancing learning effectiveness requires one to define suitable learning outcomes and align assessment constructs with these outcomes. We present a quad-faceted feature-based graph network to classify assessment texts into domain-agnostic class labels more accurately. The proposed model incorporates four complementary graphs (syntactic, semantic, sequential, and topical) with observable and latent node types and unique edge weight computations that are dependent on node properties to extract unique features from a given text. The purpose of incorporating syntactic information is to consider the dependency parsing between word nodes, while the semantic information is to provide the algorithm with contextual similarity between phrase nodes that are more effective than words in encapsulating the meaning of a text. The sequential graph is applied to regular expression nodes that contribute to a domain-agnostic class label, while the topical graph identifies topics that are convergent to each other based on their distributions. As opposed to existing techniques that construct graphs solely based on word nodes, the proposed model exploits the benefits of term weighting, nested phrases, regular expressions, and topic modeling to develop a diverse heterogeneous architecture for text classification. We evaluate the classification performance on questions with different class labels such as cognitive complexities, reasoning capabilities, and question types, as well as longer documents. Experiment results show that the proposed model outperforms in terms of macroaverage F1 score when compared with existing deep learning techniques. We also demonstrate the application of the classification model to understand learners' attitudes via an empirical study in a workplace-learning environment.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Supraja, S.
Khong, Andy Wai Hoong
format Article
author Supraja, S.
Khong, Andy Wai Hoong
author_sort Supraja, S.
title Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
title_short Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
title_full Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
title_fullStr Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
title_full_unstemmed Quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
title_sort quad-faceted feature-based graph network for domain-agnostic text classification to enhance learning effectiveness
publishDate 2025
url https://hdl.handle.net/10356/182007
_version_ 1821237179494432768