A decision support system in precision medicine: contrastive multimodal learning for patient stratification

• Main Authors: Yin, Qing, Zhong, Linda, Song, Yunya, Bai, Liang, Wang, Zhihua, Li, Chen, Xu, Yida, Yang, Xian
• Other Authors: School of Biological Sciences
• Format: Article
• Language: English
• Published: 2024
• Subjects: Medicine, Health and Life Sciences; Deep learning model for patient stratification; Multimodal contrastive learning
• Online Access: https://hdl.handle.net/10356/174319
• Institution: Nanyang Technological University

Precision medicine aims to provide personalized healthcare for patients by stratifying them into subgroups based on their health conditions, enabling the development of tailored medical management. Various decision support systems (DSSs) are increasingly developed in this field, where the performance is limited to their capability of handling big amounts of heterogeneous and high-dimensional electronic health records (EHRs). In this paper, we focus on developing a deep learning model for patient stratification that can identify and explain patient subgroups from multimodal EHRs. The primary challenge is to effectively align and unify heterogeneous information from various modalities, which includes both unstructured and structured data. Here, we develop a Contrastive Multimodal learning model for EHR (ConMEHR) based on topic modelling. In ConMEHR, modality-level and topic-level contrastive learning (CL) mechanisms are adopted to obtain a unified representation space and diversify patient subgroups, respectively. The performance of ConMEHR will be evaluated on two real-world EHR datasets and the results show that our model outperforms other baseline methods.