Autism spectrum self-stimulatory behaviors classification using explainable temporal coherency deep features and SVM classifier

• Main Authors: Liang, Shuaibing, Md Sabri, Aznul Qalid, Alnajjar, Fady, Loo, Chu Kiong
• Format: Article
• Published: IEEE-Inst Electrical Electronics Engineers Inc 2021
• Subjects: QA75 Electronic computers. Computer science; T Technology (General)
• Online Access: http://eprints.um.edu.my/26397/
• Institution: Universiti Malaya

Autism spectrum disorder is a very common disorder. An early diagnosis of autism is essential for the prognosis of this disorder. The common diagnosis method utilizes behavioural cues of autistic children. Doctors require years of clinical training to acquire the ability to capture these behavioural cues (such as self-stimulatory behaviours). In recent years, the advancement of deep learning algorithms and hardware enabled the use of artificial intelligence technology to automatically capture self-stimulatory behaviours. Using this technique, the work efficacy of doctors can be improved. However, the field of self-stimulatory behaviours research still lacks large annotated data to train the model. Therefore, the application of unsupervised machine learning methods is adopted. Meanwhile, it is often difficult to obtain good classification results using unlabelled data, further research to train a model that can obtain good classification results and at the same time being practical will be valuable. Nevertheless, in the area of machine learning, the interpretability of the created model has to be vital as well. Hence, we have employed the Layer-wise Relevance Propagation (LRP) method to explain the proposed model. In this article, the major innovation is utilizing the temporal coherency between adjacent frames as free supervision and setting a global discriminative margin to extract slow-changing discriminative self-stimulatory behaviours features. Extensive evaluation of the extracted features has proven the effectiveness of those features. Firstly, the extracted features are classified by the k-means method to show the classification of self-stimulation behaviours in a completely unsupervised way. Then, the conditional entropy method is used to evaluate the effectiveness of features. Secondly, we have obtained the state-of-the-art results by combining the unsupervised TCDN method with optimised supervised learning methods (such as SVM, k-NN, Discriminant). These state-of-the-art results prove the effectiveness of the slow-changing discriminative self-stimulatory behaviours features.