Automatic short answer grading using Siamese bidirectional LSTM based regression

• Main Authors: PRABHUDESAI, Arya, TA, Nguyen Binh Duong
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: automatic grading; feature engineering; neural networks; short answer; Siamese LSTM; Databases and Information Systems; Numerical Analysis and Scientific Computing
• Online Access: https://ink.library.smu.edu.sg/sis_research/6064; https://ink.library.smu.edu.sg/context/sis_research/article/7067/viewcontent/Automatic_Short_Answer_Grading_using_Siamese_Bidirectional_LSTM_Based_Regression.pdf
• Institution: Singapore Management University

Automatic student assessment plays an important role in education - it provides instant feedback to learners, and at the same time reduces tedious grading workload for instructors. In this paper, we investigate new machine learning techniques for automatic short answer grading (ASAG). The ASAG problem mainly involves assessing short, natural language responses to given questions automatically. While current research in the field has focused either on feature engineering or deep learning, we propose a new approach which combines the advantages of both. More specifically, we propose a Siamese Bidirectional LSTM Neural Network based Regressor in conjunction with handcrafted features for ASAG. Extensive experiments using the popular Mohler ASAG dataset which contains training samples from Computer Science courses, have demonstrated that our system, despite being simpler, provides similar or better overall performance in terms of grading accuracy (measured with Pearson r, mean absolute error and root mean squared error) compared to state-of-the-art results.