Q-instruct: improving low-level visual abilities for multi-modality foundation models

• Main Authors: Wu, Haoning, Zhang, Zicheng, Zhang, Erli, Chen, Chaofeng, Liao, Liang, Wang, Annan, Xu, Kaixin, Li, Chunyi, Hou, Jingwen, Zhai, Guangtao, Xue, Geng, Sun, Wenxiu, Yan, Qiong, Lin, Weisi
• 其他作者: College of Computing and Data Science
• 格式: Conference or Workshop Item
• 語言: English
• 出版: 2024
• 主題: Computer and Information Science; Multi-modality large language models; Computer vision
• 在線閱讀: https://hdl.handle.net/10356/178464; http://arxiv.org/abs/2311.06783v1; https://openaccess.thecvf.com/content/CVPR2024/papers/Wu_Q-Instruct_Improving_Low-level_Visual_Abilities_for_Multi-modality_Foundation_Models_CVPR_2024_paper.pdf

Multi-modality foundation models, as represented by GPT-4V, have brought a new paradigm for low-level visual perception and understanding tasks, that can respond to a broad range of natural human instructions in a model. While existing foundation models have shown exciting potentials on low-level...