Predicting levels of rapport in dyadic interactions through automatic detection of posture and posture congruence

• Main Authors: Hagad, Juan Lorenzo, Legaspi, Roberto S., Numao, Masayuki, Suarez, Merlin Teodosia C.
• Format: text
• Published: Animo Repository 2011
• Subjects: Image processing; Pattern recognition systems; Posture; Machine learning; Computer Sciences
• Online Access: https://animorepository.dlsu.edu.ph/faculty_research/2583
• Institution: De La Salle University

Research in psychology and SSP often describe posture as one of the most expressive nonverbal cues. Various studies in psychology particularly link posture mirroring behaviour to rapport. Currently, however, there are few studies which deal with the automatic analysis of postures and none at all particularly focus on its connection with rapport. This study presents a method for automatically predicting rapport in dyadic interactions based on posture and congruence. We begin by constructing a dataset of dyadic interactions and selfreported rapport annotations. Then, we present a simple system for posture classification and use it to detect posture congruence in dyads. Sliding time windows are used to collect posture congruence statistics across video segments. And lastly, various machine learning techniques are tested and used to create rapport models. Among the machine learners tested, Support Vector Machines and Multilayer Perceptrons performed best, at around 71% average accuracy. © 2011 IEEE.