Learning analytics in informal, participatory collaborative learning

• Main Authors: CHEONG, Michelle L. F., SINGH, Aditya, CHEN, Yun-Chen, DAI, Bing Tian
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Q&A forum; text mining; natural language processing; machine learning; impact assessment; informal learning; participatory collaborative learning; workplace learning; Databases and Information Systems; Educational Assessment, Evaluation, and Research; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/7773; https://doi.org/10.1007/978-981-19-4460-4_19
• Institution: Singapore Management University

Learning Analytics was recognized to be “the third wave of large-scale developments in instructional technology”. Learning Management Systems (LMSs) have been widely adopted as the learning analytics tools because the captured data represents how the learners’ interact with the system during formal learning. However, most LMSs’ analytics models do not capture learning activities outside the systems. We built an integrated Telegram mobile application and a web-based portal discussion forum, to enable informal, participatory and collaborative learning beyond the classroom. We analyzed student-initiated question-and-answer discussion posts where our machine learning algorithm will predict the quality of the posts, and the system will prompt the students to improve their posts. With six in-built engagement features, our system generated higher number of high-quality posts, resulting in better learning outcomes among the students. Based on three implementation runs in an undergraduate course, our results show that there were positive correlations between post quality and student assessment outcomes. Students who used the system could achieve higher knowledge gain, and in-class intervention by the course instructor to review the weekly discussion posts will further improve knowledge gain. Mandatory participation benefitted the academically stronger students, while academically weaker students will need positive intervention actions when mandatory use of the system is enforced. We envisage that our system can be a successful alternative for workplace learning and ultimately contribute to organization knowledge creation. Using the system, working professionals can post questions and answers shared among peers within their own organizations and learn through such informal discussions, which can be blended seamlessly in their day-to-day workflow. While our system has not been implemented in workplace learning, we attempt to draw inference from our implementation results, to understand the parallels in the business organization context.