Facial expression conversion with generative adversarial network

StarGAN realizes image conversion among multiple domain image, but the combined and coordinated actions of facial muscles are still discrete and limited in datasets. The function of facial expression conversion of StarGAN cannot satisfy the command of realism in areas, such as movie industry, fashio...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Xi, Yihong
مؤلفون آخرون: Jiang Xudong
التنسيق: Thesis-Master by Coursework
اللغة:English
منشور في: Nanyang Technological University 2020
الموضوعات:
الوصول للمادة أونلاين:https://hdl.handle.net/10356/141311
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
الوصف
الملخص:StarGAN realizes image conversion among multiple domain image, but the combined and coordinated actions of facial muscles are still discrete and limited in datasets. The function of facial expression conversion of StarGAN cannot satisfy the command of realism in areas, such as movie industry, fashion industry and so on. Besides, GANs like CycleGAN and WGAN-GP, are provided as basic models for GANimation. Successful generator network architecture like Resnet and discriminator architecture like Patch discriminator are the basic neural network of this project. Moreover, the idea of using action units and its intensity as representation of different facial expression, not traditional feature extraction method improves conversion accuracy and speed. In this project, we train and test a model on dataset CelebA to realize facial expression conversion, which describes anatomically human facial expressions in a continuous domain. And only the intensity of activated AUs are used.