Evolving storytelling: benchmarks and methods for new character customization with diffusion models

• Main Authors: Wang, Xiyu, Wang, Yufei, Tsutsui, Satoshi, Lin, Weisi, Wen, Bihan, Kot, Alex Chichung
• Other Authors: Interdisciplinary Graduate School (IGS)
• Format: Conference or Workshop Item
• Language: English
• Published: 2024
• Subjects: Computer and Information Science; Generative diffusion model; Story visualization; Generative model customization
• Online Access: https://hdl.handle.net/10356/180038; https://2024.acmmm.org/accepted-list; https://dl.acm.org/doi/10.1145/3664647.3681373
• Institution: Nanyang Technological University

Diffusion-based models for story visualization have shown promise in generating content-coherent images for storytelling tasks. However, how to effectively integrate new characters into existing narratives while maintaining character consistency remains an open problem, particularly with limited dat...