Transforming assessment with LLM and generative AI: impacts and challenges

The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have impacted our ways of doing many things. Given its central role in accrediting knowledge and skills, assessment positions itself at the forefront of these impacts. Applying cutting-edge large language models (LLMs) a...

Full description

Saved in:
Bibliographic Details
Main Author: Hao, Jiangang
Other Authors: School of Mechanical and Aerospace Engineering
Format: Conference or Workshop Item
Language:English
Published: 2024
Subjects:
Online Access:https://hdl.handle.net/10356/181098
https://www.ntu.edu.sg/mae/ai-education-singapore-2024/activities/keynote-invited-talk#Content_C021_Col00
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have impacted our ways of doing many things. Given its central role in accrediting knowledge and skills, assessment positions itself at the forefront of these impacts. Applying cutting-edge large language models (LLMs) and generative AI to assessment holds great promise in boosting efficiency, mitigating bias, and facilitating customized evaluations. Conversely, these innovations raise significant concerns regarding validity, reliability, transparency, fairness, equity, and test security, necessitating careful thinking when applying them in assessments. In this talk, I will discuss the impacts and implications of LLMs and generative AI on critical dimensions of assessment with example use cases and highlight the challenges that call for a community effort to address.