Exploring a multimodal fusion-based deep learning network for detecting facial palsy

• Main Authors: OO, Heng Yim Nicole, LEE, Min Hun, LIM, J. H.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Machine Learning; Computer Vision; Multimodal Fusion; Facial Analysis; Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/9958; https://ink.library.smu.edu.sg/context/sis_research/article/10958/viewcontent/2405.16496v1.pdf
• Institution: Singapore Management University

Algorithmic detection of facial palsy offers the potential to improve current practices, which usually involve labor-intensive and subjective assessment by clinicians. In this paper, we present a multimodal fusion-based deep learning model that utilizes unstructured data (i.e. an image frame with fa...