Analytics-enabled authentic assessment design approach for digital education

• Main Authors: LIM, Tristan, GOTTIPATI, Swapna, CHEONG, Michelle L. F., NG, Jun Wei, PANG, Christopher
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: Authentic Assessment Design; Digital Education; Pilot Study; Gamified Heutagogical Multi-modal AI-driven (“GHMA”) Approach; Learner Experience and Satisfaction; Computer Sciences; Educational Assessment, Evaluation, and Research
• Online Access: https://ink.library.smu.edu.sg/sis_research/7764; https://ink.library.smu.edu.sg/context/sis_research/article/8767/viewcontent/s10639_022_11525_3_pv.pdf
• Institution: Singapore Management University

There are known issues in authentic assessment design practices in digital education, which include the lack of freedom-of-choice, lack of focus on the multimodal nature of the digital process, and shortage of effective feedbacks. This study looks to identify an assessment design construct that overcomes these issues. Specifically, this study introduces an authentic assessment that combines gamification (G) with heutagogy (H) and multimodality (M) of assessments, building upon rich pool of multimodal data and learning analytics (A), known as GHMA. This is a skills-oriented assessment approach, where learners determine their own goals and create individualized multimodal artefacts, receive cognitive challenge through cognitively complex tasks structured in gamified non-linear learning paths, while reflecting on personal growth through personalized feedback derived from learning analytics. This pilot research looks to: (i) establish validity of all elements within the assessment design, and (ii) identify if application of assessment design leads to improved learner satisfaction. Results showed positive validations of all key elements of the GHMA assessment model, as beneficial factors tied to positive learner satisfaction on assessment delivery. There existed statistically significant post- and pre-treatment differences between experimental and control group satisfaction levels, indicating positive receptivity of GHMA authentic assessment design in digital education.