Gesture-based affect modeling for intelligent tutoring systems

• Main Authors: Bustos, Dana May, Chua, Geoffrey Loren, Cruz, Richard Thomas, Santos, Jose Miguel, Suarez, Merlin Teodosia
• Format: text
• Published: Animo Repository 2011
• Subjects: Affect (Psychology); Gesture; Pattern recognition systems; Intelligent tutoring systems; Computer Sciences
• Online Access: https://animorepository.dlsu.edu.ph/faculty_research/1450; https://animorepository.dlsu.edu.ph/context/faculty_research/article/2449/type/native/viewcontent
• Institution: De La Salle University

This paper investigates the feasibility of using gestures and posture for building affect models for an ITS. Recordings of students studying with a computer were taken and an HMM was built to recognize gestures and posture. Results indicate distinctions can be achieved with an accuracy of 43.10% using leave-one out cross validation. Results further indicate the relevance of hand location, movement and speed of movement as features for affect modeling using gestures and posture. © 2011 Springer-Verlag Berlin Heidelberg.