Unsupervised modality adaptation with text-to-Image diffusion models for semantic segmentation

• Main Authors: XIA, Ruihao, LIANG, Yu, JIANG, Peng-Tao, ZHANG, Hao, LI, Bo, TANG, Yang, ZHOU, Pan
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Semantic Segmentation; Modality adaptation; Text-to-Image diffusion models; Domain adaptation; Computer Sciences; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/9729; https://ink.library.smu.edu.sg/context/sis_research/article/10729/viewcontent/2410.21708v1.pdf
• Institution: Singapore Management University

Despite their success, unsupervised domain adaptation methods for semantic segmentation primarily focus on adaptation between image domains and do not utilize other abundant visual modalities like depth, infrared and event. This limitation hinders their performance and restricts their application in...