Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals

Negative symptoms of schizophrenia significantly affect the daily functioning of patients, especially movement and expressive gestures. The diagnosis of such symptoms is often difficult and require the expertise of a trained clinician. Apart from these subjective methods, there is little research on...

Full description

Saved in:
Bibliographic Details
Main Authors: Chakraborty, Debsubhra, Tahir, Yasir, Yang, Zixu, Maszczyk, Tomasz, Dauwels, Justin, Thalmann, Daniel, Magnenat Thalmann, Nadia, Tan, Bhing-Leet, Lee, Jimmy
Other Authors: School of Electrical and Electronic Engineering
Format: Conference or Workshop Item
Language:English
Published: 2017
Subjects:
Online Access:https://hdl.handle.net/10356/83648
http://hdl.handle.net/10220/43560
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-83648
record_format dspace
spelling sg-ntu-dr.10356-836482020-09-26T22:04:10Z Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals Chakraborty, Debsubhra Tahir, Yasir Yang, Zixu Maszczyk, Tomasz Dauwels, Justin Thalmann, Daniel Magnenat Thalmann, Nadia Tan, Bhing-Leet Lee, Jimmy School of Electrical and Electronic Engineering Interdisciplinary Graduate School (IGS) 2017 IEEE 19th International Workshop on Multimedia Signal Processing Graduate Studies Office Institute of Mental Health Institute for Media Innovation Research Techno Plaza Negative symptoms Schizophrenia Negative symptoms of schizophrenia significantly affect the daily functioning of patients, especially movement and expressive gestures. The diagnosis of such symptoms is often difficult and require the expertise of a trained clinician. Apart from these subjective methods, there is little research on developing objective methods to quantify the symptoms. Therefore, we explore body movement signals as objective measures of negative symptoms. Specifically, we extract the signals from video recordings of patients being interviewed. We analysed the interviews of 69 paid participants (46 patients and 23 healthy controls) in this study. Correlation between movement signals (linear and angular speeds of upper limbs and head, acceleration and gesture angles) and subjective ratings (assigned during same interview) from the NSA-16 scale were calculated. As hypothesized, the movement signals correlated strongly with the movement impairment aspect of the NSA-16 questionnaire. Also, not quite surprisingly, strong correlations were obtained between the movement signals and speech items of NSA-16, indicating lack of associated gestures in patients during speech. These subjective ratings could also be reasonably predicted from the objective signals with an accuracy of 61-78 % using machine-learning algorithms with leave-one-out cross-validation technique. Furthermore, these objective measures can be reliably utilized to distinguish between the patient and healthy groups, as supervised learning methods can classify the two groups with 74-87 % accuracy. NRF (Natl Research Foundation, S’pore) NMRC (Natl Medical Research Council, S’pore) Accepted version 2017-08-07T04:40:41Z 2019-12-06T15:27:28Z 2017-08-07T04:40:41Z 2019-12-06T15:27:28Z 2017 Conference Paper Chakraborty, D., Tahir, Y., Yang, Z., Maszczyk, T., Dauwels, J., Thalmann, D., et al. (2017). Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals. 2017 IEEE 19th International Workshop on Multimedia Signal Processing. https://hdl.handle.net/10356/83648 http://hdl.handle.net/10220/43560 en © 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. 6 p. application/pdf
institution Nanyang Technological University
building NTU Library
country Singapore
collection DR-NTU
language English
topic Negative symptoms
Schizophrenia
spellingShingle Negative symptoms
Schizophrenia
Chakraborty, Debsubhra
Tahir, Yasir
Yang, Zixu
Maszczyk, Tomasz
Dauwels, Justin
Thalmann, Daniel
Magnenat Thalmann, Nadia
Tan, Bhing-Leet
Lee, Jimmy
Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals
description Negative symptoms of schizophrenia significantly affect the daily functioning of patients, especially movement and expressive gestures. The diagnosis of such symptoms is often difficult and require the expertise of a trained clinician. Apart from these subjective methods, there is little research on developing objective methods to quantify the symptoms. Therefore, we explore body movement signals as objective measures of negative symptoms. Specifically, we extract the signals from video recordings of patients being interviewed. We analysed the interviews of 69 paid participants (46 patients and 23 healthy controls) in this study. Correlation between movement signals (linear and angular speeds of upper limbs and head, acceleration and gesture angles) and subjective ratings (assigned during same interview) from the NSA-16 scale were calculated. As hypothesized, the movement signals correlated strongly with the movement impairment aspect of the NSA-16 questionnaire. Also, not quite surprisingly, strong correlations were obtained between the movement signals and speech items of NSA-16, indicating lack of associated gestures in patients during speech. These subjective ratings could also be reasonably predicted from the objective signals with an accuracy of 61-78 % using machine-learning algorithms with leave-one-out cross-validation technique. Furthermore, these objective measures can be reliably utilized to distinguish between the patient and healthy groups, as supervised learning methods can classify the two groups with 74-87 % accuracy.
author2 School of Electrical and Electronic Engineering
author_facet School of Electrical and Electronic Engineering
Chakraborty, Debsubhra
Tahir, Yasir
Yang, Zixu
Maszczyk, Tomasz
Dauwels, Justin
Thalmann, Daniel
Magnenat Thalmann, Nadia
Tan, Bhing-Leet
Lee, Jimmy
format Conference or Workshop Item
author Chakraborty, Debsubhra
Tahir, Yasir
Yang, Zixu
Maszczyk, Tomasz
Dauwels, Justin
Thalmann, Daniel
Magnenat Thalmann, Nadia
Tan, Bhing-Leet
Lee, Jimmy
author_sort Chakraborty, Debsubhra
title Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals
title_short Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals
title_full Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals
title_fullStr Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals
title_full_unstemmed Assessment and Prediction of Negative Symptoms of Schizophrenia from RGB+D Movement Signals
title_sort assessment and prediction of negative symptoms of schizophrenia from rgb+d movement signals
publishDate 2017
url https://hdl.handle.net/10356/83648
http://hdl.handle.net/10220/43560
_version_ 1681059070662934528